Apr 24 19:46:50 devstack cinder-volume[72005]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:46:50 devstack cinder-volume[72005]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:46:50 devstack cinder-volume[72005]: we strongly recommend against using it for new projects. Apr 24 19:46:50 devstack cinder-volume[72005]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:46:50 devstack cinder-volume[72005]: framework. For more detail see Apr 24 19:46:50 devstack cinder-volume[72005]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:46:50 devstack cinder-volume[72005]: import eventlet # noqa Apr 24 19:46:52 devstack cinder-volume[72005]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:46:52 devstack cinder-volume[72005]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:46:52 devstack cinder-volume[72005]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:46:52 devstack cinder-volume[72005]: INFO dbcounter [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Registered counter for database cinder Apr 24 19:46:52 devstack cinder-volume[72005]: DEBUG oslo_db.sqlalchemy.engines [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:46:52 devstack cinder-volume[72005]: DEBUG dbcounter [-] [72005] Writer thread running {{(pid=72005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:46:52 devstack cinder-volume[72005]: INFO cinder.rpc [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:46:52 devstack cinder-volume[72005]: INFO cinder.rpc [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:46:52 devstack cinder-volume[72005]: DEBUG oslo_db.sqlalchemy.engines [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:46:53 devstack cinder-volume[72005]: INFO cinder.volume.manager [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Determined volume DB was empty at startup. Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG cinder.volume.manager [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72005) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:46:53 devstack cinder-volume[72005]: INFO cinder.volume.manager [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 19:46:53 devstack cinder-volume[72005]: WARNING stevedore.named [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:46:53 devstack cinder-volume[72005]: WARNING castellan.key_manager [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:46:53 devstack cinder-volume[72005]: WARNING cinder.keymgr.conf_key_mgr [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG cinder.volume.drivers.lvm [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72005) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_concurrency.processutils [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_concurrency.processutils [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] CMD "cinder-rtstool verify" returned: 0 in 0.289s {{(pid=72005) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_db.sqlalchemy.engines [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:46:53 devstack cinder-volume[72005]: INFO cinder.rpc [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 24 19:46:53 devstack cinder-volume[72005]: INFO cinder.rpc [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 24 19:46:53 devstack cinder-volume[72005]: WARNING stevedore.named [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:46:53 devstack cinder-volume[72005]: WARNING castellan.key_manager [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:46:53 devstack cinder-volume[72005]: INFO cinder.volume.manager [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_db.sqlalchemy.engines [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:46:53 devstack cinder-volume[72005]: INFO oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Starting 1 workers Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Started child 72112 {{(pid=72005) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Full set of CONF: {{(pid=72005) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] ******************************************************************************** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Configuration options gathered from: {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] ================================================================================ {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] allow_availability_zone_fallback = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] allow_compression_on_image_upload = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] allowed_direct_url_schemes = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] api_rate_limit = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] auth_strategy = keystone {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] az_cache_duration = 3600 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_availability_zone = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_host = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_stats_polling_interval = 60 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backup_api_class = cinder.backup.api.API {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backup_name_template = backup-%s {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backup_use_same_host = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backup_use_temp_snapshot = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] chap_password = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] chap_username = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cinder_internal_tenant_project_id = 1fa816bd5fe14ca49d080217d2782a1f {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cinder_internal_tenant_user_id = 62654c66acea4cf388920b8f8b0bbda9 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cloned_volume_same_az = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cluster = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] compression_format = gzip {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] compute_api_class = cinder.compute.nova.API {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] config_dir = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] config_source = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] control_exchange = openstack {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] debug = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] default_availability_zone = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] default_group_type = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] default_volume_type = lvmdriver-1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] disk_geometry = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] driver_client_cert = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] driver_client_cert_key = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] driver_data_namespace = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] driver_ssl_cert_path = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] driver_ssl_cert_verify = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] driver_use_ssl = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] enable_force_upload = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] enable_new_services = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] enable_unsupported_driver = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] enforce_multipath_for_image_xfer = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] filter_function = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_api_insecure = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_api_servers = ['http://192.168.122.11/image'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_api_ssl_compression = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_ca_certificates_file = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_catalog_info = image:glance:publicURL {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_certfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_keyfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_num_retries = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance_request_timeout = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] goodness_function = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] graceful_shutdown_timeout = 5 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] group_api_class = cinder.group.api.API {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] host = devstack {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_compress_on_upload = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_conversion_address_space_limit = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_conversion_cpu_limit = 60 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_conversion_disable = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_upload_use_cinder_backend = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_upload_use_internal_tenant = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_volume_cache_enabled = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_volume_cache_max_count = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] image_volume_cache_max_size_gb = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] init_host_max_objects_retrieval = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] instance_format = [instance: %(uuid)s] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] iscsi_target_flags = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] iscsi_write_cache = on {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] iser_helper = tgtadm {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] iser_ip_address = 192.168.122.11 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] iser_port = 3260 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] log_color = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] log_config_append = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] log_dir = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] log_file = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] log_options = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] log_rotate_interval = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] log_rotate_interval_type = days {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] log_rotation_type = none {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] max_age = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] max_logfile_count = 30 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] max_logfile_size_mb = 200 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] max_over_subscription_ratio = 20.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] message_reap_interval = 86400 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] message_ttl = 2592000 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] migration_create_volume_timeout_secs = 300 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] monkey_patch = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] monkey_patch_modules = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] my_ip = 192.168.122.11 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] no_snapshot_gb_quota = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] num_iser_scan_tries = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] num_shell_tries = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] num_volume_device_scan_tries = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] nvmeof_conn_info_version = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] nvmet_ns_id = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] nvmet_port_id = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] osapi_max_limit = 1000 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] osapi_volume_ext_list = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] osapi_volume_listen_port = 8776 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] osapi_volume_use_ssl = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] osapi_volume_workers = 2 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] per_volume_size_limit = -1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] periodic_fuzzy_delay = 60 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] periodic_interval = 60 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] public_endpoint = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] publish_errors = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] quota_backup_gigabytes = 1000 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] quota_backups = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] quota_gigabytes = 1000 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72112]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] quota_groups = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] quota_snapshots = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] quota_volumes = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] rate_limit_burst = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] rate_limit_except_level = CRITICAL {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] rate_limit_interval = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] reinit_driver_count = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] replication_device = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] report_discard_supported = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] report_interval = 120 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] reservation_clean_interval = 86400 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] reservation_expire = 86400 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] reserved_image_namespaces = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] reserved_percentage = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] rpc_response_timeout = 120 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] run_external_periodic_tasks = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] scst_target_driver = iscsi {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] scst_target_iqn_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_down_time = 720 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] shell_completion = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] snapshot_name_template = snapshot-%s {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] snapshot_same_host = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] split_loggers = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] state_path = /opt/stack/data/cinder {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] storage_availability_zone = nova {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72112]: INFO cinder.volume.manager [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] storage_protocol = iSCSI {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] syslog_log_facility = LOG_USER {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] target_helper = lioadm {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] target_ip_address = 192.168.122.11 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] target_port = 3260 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] target_protocol = iscsi {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] target_secondary_ip_addresses = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] trace_flags = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] transport_url = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] until_refresh = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] use_chap_auth = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] use_default_quota_class = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] use_journal = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] use_json = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] use_multipath_for_image_xfer = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] use_stderr = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] use_syslog = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] verify_glance_signatures = enabled {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_api_class = cinder.volume.api.API {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_backend_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_clear = zero {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_clear_ionice = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_clear_size = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_copy_bps_limit = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_dd_blocksize = 1M {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_name_template = volume-%s {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_service_inithost_offload = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volume_usage_audit_period = month {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] zoning_mode = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_concurrency.disable_process_locking = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.admin_password = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.admin_token = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.admin_user = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.auth_port = 35357 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.auth_protocol = https {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.auth_section = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.auth_type = password {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.auth_uri = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.auth_version = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.cache = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.certfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.identity_uri = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.include_service_catalog = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.insecure = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.interface = public {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.keyfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_password = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcache_username = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.region_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.service_type = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.11/identity {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.backend = dogpile.cache.null {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.backend_argument = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.backend_expiration_time = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.config_prefix = cache.oslo {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.debug_cache_backend = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.enable_retry_client = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.enable_socket_keepalive = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.enabled = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.enforce_fips_mode = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.expiration_time = 600 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.hashclient_retry_attempts = 2 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.memcache_dead_retry = 300 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.memcache_pool_maxsize = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.memcache_sasl_enabled = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.password = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.proxies = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.redis_db = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.redis_server = localhost:6379 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.retry_attempts = 2 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.retry_delay = 0.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.socket_keepalive_count = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.socket_keepalive_idle = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.socket_keepalive_interval = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.socket_timeout = 1.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.tls_allowed_ciphers = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.tls_cafile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.tls_certfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.tls_enabled = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.tls_keyfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack sudo[72152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cache.username = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack sudo[72152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] coordination.backend_url = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.asyncio_connection = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.asyncio_slave_connection = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.backend = sqlalchemy {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.connection = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.connection_debug = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.connection_parameters = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.connection_recycle_time = 3600 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.connection_trace = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.db_inc_retry_interval = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.db_max_retries = 20 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.db_max_retry_interval = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.db_retry_interval = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.max_overflow = 50 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.max_pool_size = 5 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.max_retries = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.mysql_wsrep_sync_wait = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.pool_timeout = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.retry_interval = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.slave_connection = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.sqlite_synchronous = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.synchronous_reader = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] database.use_db_reconnect = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.connection_string = messaging:// {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.enabled = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.es_doc_type = notification {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.es_scroll_size = 10000 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.es_scroll_time = 2m {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.filter_error_trace = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.hmac_keys = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.sentinel_service_name = mymaster {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.socket_timeout = 0.1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.trace_requests = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler.trace_sqlalchemy = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler_jaeger.process_tags = {} {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler_jaeger.service_name_prefix = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] profiler_otlp.service_name_prefix = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.enforce_new_defaults = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: WARNING oslo_config.cfg [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.enforce_scope = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.policy_default_rule = default {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.policy_file = policy.yaml {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] privsep_osbrick.group = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] privsep_osbrick.helper_command = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] privsep_osbrick.user = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cinder_sys_admin.group = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cinder_sys_admin.helper_command = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] cinder_sys_admin.user = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.auth_section = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.auth_type = password {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.cafile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.certfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.collect_timing = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.insecure = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.keyfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.send_service_user_token = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.split_loggers = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] service_user.timeout = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.auth_section = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.auth_type = password {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.certfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.collect_timing = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.insecure = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.keyfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.region_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.split_loggers = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] glance.timeout = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.backend_availability_zone = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.chap_password = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.chap_username = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.disk_geometry = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.driver_client_cert = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.driver_client_cert_key = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.driver_data_namespace = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.driver_use_ssl = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.extra_capabilities = {} {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.filter_function = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.goodness_function = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.iscsi_target_flags = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.iscsi_write_cache = on {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.iser_helper = tgtadm {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.iser_port = 3260 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.lvm_share_target = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.lvm_type = auto {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.num_shell_tries = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.replication_device = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.report_discard_supported = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.reserved_percentage = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.target_helper = tgtadm {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.target_port = 3260 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.target_protocol = iscsi {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.trace_flags = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.unique_fqdn_network = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.use_chap_auth = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volume_backend_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volume_clear = zero {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volume_clear_ionice = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volume_clear_size = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_reports.file_event_handler = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_reports.log_dir = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.backend_host = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.chap_password = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.chap_username = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.disk_geometry = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.driver_client_cert = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.extra_capabilities = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.filter_function = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.goodness_function = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.iser_helper = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.iser_ip_address = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.iser_port = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.lvm_share_target = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.lvm_type = auto {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.num_shell_tries = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.replication_device = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.report_discard_supported = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.reserved_percentage = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.scst_target_driver = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.storage_protocol = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.target_helper = lioadm {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.target_ip_address = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.target_port = 3260 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.trace_flags = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.use_chap_auth = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volume_clear = zero {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volume_clear_size = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] lvmdriver-1.volumes_dir = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.ssl = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_notifications.driver = [] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_notifications.retry = -1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] key_manager.fixed_key = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.barbican_api_version = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.barbican_endpoint = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.barbican_endpoint_type = public {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.barbican_region_name = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.cafile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.certfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.collect_timing = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.insecure = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.keyfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.number_of_retries = 60 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.retry_delay = 1 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.send_service_user_token = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.split_loggers = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.timeout = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.verify_ssl = True {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican.verify_ssl_path = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican_service_user.auth_section = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican_service_user.auth_type = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican_service_user.cafile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican_service_user.certfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican_service_user.collect_timing = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican_service_user.insecure = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican_service_user.keyfile = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican_service_user.split_loggers = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] barbican_service_user.timeout = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.approle_role_id = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.approle_secret_id = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.kv_mountpoint = secret {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.kv_path = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.kv_version = 2 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.namespace = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.root_token_id = **** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.ssl_ca_crt_file = None {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.timeout = 60.0 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.use_ssl = False {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:46:53 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] ******************************************************************************** {{(pid=72005) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:46:54 devstack sudo[72152]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:54 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.563s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:54 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:54 devstack sudo[72374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:46:54 devstack sudo[72374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:54 devstack sudo[72374]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:54 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.566s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:54 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:46:54 devstack cinder-volume[72112]: INFO cinder.brick.local_dev.lvm [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 24 19:46:54 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:54 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:54 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:54 devstack sudo[72602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:46:54 devstack sudo[72602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:55 devstack sudo[72602]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:55 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:55 devstack cinder-volume[72112]: DEBUG cinder.brick.local_dev.lvm [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72112) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 24 19:46:55 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:55 devstack sudo[72668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:46:55 devstack sudo[72668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:56 devstack sudo[72668]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:56 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.908s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:56 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:56 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:56 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:56 devstack sudo[72803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:46:56 devstack sudo[72803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:56 devstack sudo[72803]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:56 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.520s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:56 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:56 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:56 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:57 devstack sudo[72808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 24 19:46:57 devstack sudo[72808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:57 devstack sudo[72808]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:57 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.450s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:57 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:57 devstack sudo[72812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:46:57 devstack sudo[72812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:57 devstack sudo[72812]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:57 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:57 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:57 devstack sudo[72817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:46:57 devstack sudo[72817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:58 devstack sudo[72817]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:58 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:58 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:58 devstack sudo[72824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:46:58 devstack sudo[72824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:58 devstack sudo[72824]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:58 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:58 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:58 devstack sudo[72828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:46:58 devstack sudo[72828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:59 devstack sudo[72828]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:59 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:59 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:59 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:59 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:59 devstack sudo[72834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:46:59 devstack sudo[72834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:46:59 devstack sudo[72834]: pam_unix(sudo:session): session closed for user root Apr 24 19:46:59 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.571s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:59 devstack cinder-volume[72112]: INFO cinder.volume.drivers.lvm [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 24 19:46:59 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:59 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:46:59 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:46:59 devstack sudo[72867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:46:59 devstack sudo[72867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:00 devstack sudo[72867]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:00 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.469s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:00 devstack cinder-volume[72112]: DEBUG cinder.volume.drivers.lvm [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Updating volume stats {{(pid=72112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:47:00 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:00 devstack sudo[72957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:47:00 devstack sudo[72957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:00 devstack sudo[72957]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:00 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:00 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:00 devstack sudo[72960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:47:00 devstack sudo[72960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:01 devstack sudo[72960]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:01 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:01 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:01 devstack sudo[73101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:47:01 devstack sudo[73101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:01 devstack sudo[73101]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:01 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:01 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:01 devstack sudo[73105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:47:01 devstack sudo[73105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:02 devstack sudo[73105]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:02 devstack cinder-volume[72112]: INFO cinder.volume.driver [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG cinder.volume.driver [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72112) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG oslo_db.sqlalchemy.engines [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72112) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG dbcounter [-] [72112] Writer thread running {{(pid=72112) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG cinder.db.sqlalchemy.api [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Building query based on filter {{(pid=72112) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG cinder.image.image_utils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72112) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:47:02 devstack cinder-volume[72112]: INFO cinder.keymgr.migration [None req-c5c72b7d-9be5-4fa1-b9bb-922bb1deffeb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG cinder.volume.drivers.lvm [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Updating volume stats {{(pid=72112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:02 devstack sudo[73113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:47:02 devstack sudo[73113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:02 devstack sudo[73113]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:02 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:02 devstack sudo[73117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:47:02 devstack sudo[73117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:03 devstack sudo[73117]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:03 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:03 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:03 devstack sudo[73121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:47:03 devstack sudo[73121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:03 devstack cinder-volume[72005]: DEBUG dbcounter [-] [72005] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72005) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:47:03 devstack sudo[73121]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:03 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.505s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:03 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:03 devstack sudo[73125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:47:03 devstack sudo[73125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:04 devstack sudo[73125]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:04 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:04 devstack cinder-volume[72112]: DEBUG cinder.manager [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Notifying Schedulers of capabilities ... {{(pid=72112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:47:04 devstack cinder-volume[72112]: INFO cinder.volume.manager [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Driver initialization completed successfully. Apr 24 19:47:04 devstack cinder-volume[72112]: INFO cinder.manager [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Initiating service 2 cleanup Apr 24 19:47:04 devstack cinder-volume[72112]: INFO cinder.manager [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Service 2 cleanup completed. Apr 24 19:47:04 devstack cinder-volume[72112]: DEBUG cinder.service [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Creating RPC server for service cinder-volume {{(pid=72112) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:47:04 devstack cinder-volume[72112]: DEBUG cinder.service [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72112) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:47:04 devstack cinder-volume[72112]: INFO cinder.volume.manager [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 24 19:47:04 devstack cinder-volume[72112]: DEBUG cinder.volume.drivers.lvm [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Updating volume stats {{(pid=72112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:47:04 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:04 devstack sudo[73132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:47:04 devstack sudo[73132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:05 devstack sudo[73132]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:05 devstack sudo[73136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:47:05 devstack sudo[73136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:05 devstack sudo[73136]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.523s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:05 devstack sudo[73145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:47:05 devstack sudo[73145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:06 devstack sudo[73145]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:06 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:06 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:47:06 devstack sudo[73148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:47:06 devstack sudo[73148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:47:06 devstack sudo[73148]: pam_unix(sudo:session): session closed for user root Apr 24 19:47:06 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:47:06 devstack cinder-volume[72112]: INFO cinder.volume.manager [None req-ef53b374-468a-4e1c-a87a-968d5b0d801e None None] Driver post RPC initialization completed successfully. Apr 24 19:47:14 devstack cinder-volume[72112]: DEBUG dbcounter [-] [72112] Writing DB stats cinder:SELECT=3 {{(pid=72112) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:47:16 devstack cinder-volume[72112]: DEBUG dbcounter [-] [72112] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72112) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:48:04 devstack cinder-volume[72112]: DEBUG oslo_service.periodic_task [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72112) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:48:04 devstack cinder-volume[72112]: DEBUG cinder.volume.drivers.lvm [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Updating volume stats {{(pid=72112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:48:04 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:48:04 devstack sudo[77768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:48:04 devstack sudo[77768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:48:04 devstack sudo[77768]: pam_unix(sudo:session): session closed for user root Apr 24 19:48:04 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:48:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:48:05 devstack sudo[77896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:48:05 devstack sudo[77896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:48:05 devstack sudo[77896]: pam_unix(sudo:session): session closed for user root Apr 24 19:48:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:48:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:48:05 devstack sudo[77923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:48:05 devstack sudo[77923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:48:05 devstack sudo[77923]: pam_unix(sudo:session): session closed for user root Apr 24 19:48:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:48:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:48:05 devstack sudo[77930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:48:05 devstack sudo[77930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:48:06 devstack sudo[77930]: pam_unix(sudo:session): session closed for user root Apr 24 19:48:06 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:48:06 devstack cinder-volume[72112]: DEBUG cinder.manager [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Notifying Schedulers of capabilities ... {{(pid=72112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:49:04 devstack cinder-volume[72112]: DEBUG oslo_service.periodic_task [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72112) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:49:04 devstack cinder-volume[72112]: DEBUG cinder.volume.drivers.lvm [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Updating volume stats {{(pid=72112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:49:04 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:49:04 devstack sudo[78293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:49:04 devstack sudo[78293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:49:05 devstack sudo[78293]: pam_unix(sudo:session): session closed for user root Apr 24 19:49:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:49:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:49:05 devstack sudo[78517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:49:05 devstack sudo[78517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:49:05 devstack sudo[78517]: pam_unix(sudo:session): session closed for user root Apr 24 19:49:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:49:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:49:05 devstack sudo[78567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:49:05 devstack sudo[78567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:49:05 devstack sudo[78567]: pam_unix(sudo:session): session closed for user root Apr 24 19:49:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:49:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:49:06 devstack sudo[78589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:49:06 devstack sudo[78589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:49:06 devstack sudo[78589]: pam_unix(sudo:session): session closed for user root Apr 24 19:49:06 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:49:06 devstack cinder-volume[72112]: DEBUG cinder.manager [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Notifying Schedulers of capabilities ... {{(pid=72112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:49:16 devstack cinder-volume[72112]: DEBUG dbcounter [-] [72112] Writing DB stats cinder:SELECT=1 {{(pid=72112) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:49:16 devstack cinder-volume[72112]: DEBUG dbcounter [-] [72112] Writing DB stats cinder:UPDATE=1 {{(pid=72112) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:50:04 devstack cinder-volume[72112]: DEBUG oslo_service.periodic_task [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72112) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:50:04 devstack cinder-volume[72112]: DEBUG cinder.volume.drivers.lvm [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Updating volume stats {{(pid=72112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:50:04 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:04 devstack sudo[80460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:50:04 devstack sudo[80460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:05 devstack sudo[80460]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:05 devstack sudo[80464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:50:05 devstack sudo[80464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:05 devstack sudo[80464]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:05 devstack sudo[80473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:50:05 devstack sudo[80473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:05 devstack sudo[80473]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:05 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:05 devstack sudo[80487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:50:05 devstack sudo[80487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:06 devstack sudo[80487]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:06 devstack cinder-volume[72112]: DEBUG oslo_concurrency.processutils [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72112) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:06 devstack cinder-volume[72112]: DEBUG cinder.manager [None req-e904ed8f-5c46-4b01-92fc-98e1b88f9f84 None None] Notifying Schedulers of capabilities ... {{(pid=72112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:50:28 devstack cinder-volume[72005]: INFO oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Caught SIGTERM, stopping children Apr 24 19:50:28 devstack cinder-volume[72005]: DEBUG oslo_concurrency.lockutils [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Acquiring lock "singleton_lock" {{(pid=72005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:50:28 devstack cinder-volume[72005]: DEBUG oslo_concurrency.lockutils [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Acquired lock "singleton_lock" {{(pid=72005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:50:28 devstack cinder-volume[72005]: DEBUG oslo_concurrency.lockutils [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Releasing lock "singleton_lock" {{(pid=72005) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:50:28 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Stop services. {{(pid=72005) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 19:50:28 devstack cinder-volume[72005]: DEBUG oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Killing children. {{(pid=72005) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 19:50:28 devstack cinder-volume[72005]: INFO oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Waiting on 1 children to exit Apr 24 19:50:29 devstack cinder-volume[72112]: DEBUG oslo_concurrency.lockutils [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Acquiring lock "singleton_lock" {{(pid=72112) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:50:29 devstack cinder-volume[72112]: DEBUG oslo_concurrency.lockutils [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Acquired lock "singleton_lock" {{(pid=72112) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:50:29 devstack cinder-volume[72112]: DEBUG oslo_concurrency.lockutils [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Releasing lock "singleton_lock" {{(pid=72112) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:50:29 devstack cinder-volume[72112]: WARNING amqp [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:50:29 devstack cinder-volume[72112]: WARNING amqp [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:50:29 devstack cinder-volume[72005]: INFO oslo_service.backend._eventlet.service [None req-131f2f52-7463-4c83-a589-0f573dff7a70 None None] Child 72112 exited with status 0 Apr 24 19:50:29 devstack cinder-volume[81086]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:50:29 devstack cinder-volume[81086]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:50:29 devstack cinder-volume[81086]: we strongly recommend against using it for new projects. Apr 24 19:50:29 devstack cinder-volume[81086]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:50:29 devstack cinder-volume[81086]: framework. For more detail see Apr 24 19:50:29 devstack cinder-volume[81086]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:50:29 devstack cinder-volume[81086]: import eventlet # noqa Apr 24 19:50:31 devstack cinder-volume[81086]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:50:31 devstack cinder-volume[81086]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:50:31 devstack cinder-volume[81086]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:50:32 devstack cinder-volume[81086]: INFO dbcounter [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Registered counter for database cinder Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81086) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG dbcounter [-] [81086] Writer thread running {{(pid=81086) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:50:32 devstack cinder-volume[81086]: INFO cinder.rpc [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:50:32 devstack cinder-volume[81086]: INFO cinder.rpc [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81086) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:50:32 devstack cinder-volume[81086]: INFO cinder.volume.manager [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Determined volume DB was empty at startup. Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG cinder.volume.manager [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81086) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:50:32 devstack cinder-volume[81086]: INFO cinder.volume.manager [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 19:50:32 devstack cinder-volume[81086]: WARNING stevedore.named [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:50:32 devstack cinder-volume[81086]: WARNING castellan.key_manager [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:50:32 devstack cinder-volume[81086]: WARNING cinder.keymgr.conf_key_mgr [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:50:32 devstack cinder-volume[81086]: INFO cinder.volume.manager [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_db.sqlalchemy.engines [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81086) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:50:32 devstack cinder-volume[81086]: INFO oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Starting 1 workers Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Started child 81244 {{(pid=81086) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Full set of CONF: {{(pid=81086) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] ******************************************************************************** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Configuration options gathered from: {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] ================================================================================ {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] allow_availability_zone_fallback = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] allow_compression_on_image_upload = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81244]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] allowed_direct_url_schemes = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] api_rate_limit = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] auth_strategy = keystone {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_availability_zone = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_host = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_stats_polling_interval = 60 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backup_api_class = cinder.backup.api.API {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backup_name_template = backup-%s {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backup_use_same_host = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backup_use_temp_snapshot = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] chap_password = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] chap_username = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cinder_internal_tenant_project_id = 1fa816bd5fe14ca49d080217d2782a1f {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cinder_internal_tenant_user_id = 62654c66acea4cf388920b8f8b0bbda9 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cluster = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] compression_format = gzip {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] compute_api_class = cinder.compute.nova.API {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] config_dir = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] config_source = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] control_exchange = openstack {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] debug = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] default_availability_zone = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] default_group_type = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] default_volume_type = QuobyteHD {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] disk_geometry = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] driver_client_cert = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] driver_client_cert_key = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] driver_data_namespace = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] driver_ssl_cert_path = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] driver_ssl_cert_verify = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] driver_use_ssl = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] enable_new_services = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] enable_unsupported_driver = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] enabled_backends = ['QuobyteHD'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] enforce_multipath_for_image_xfer = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] filter_function = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_api_insecure = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_api_servers = ['http://192.168.122.11/image'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_api_ssl_compression = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_ca_certificates_file = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_catalog_info = image:glance:publicURL {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_certfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_keyfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_num_retries = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance_request_timeout = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] goodness_function = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] graceful_shutdown_timeout = 5 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] group_api_class = cinder.group.api.API {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] host = devstack {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_compress_on_upload = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_conversion_address_space_limit = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_conversion_cpu_limit = 60 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_conversion_disable = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_upload_use_cinder_backend = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_upload_use_internal_tenant = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_volume_cache_enabled = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_volume_cache_max_count = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] image_volume_cache_max_size_gb = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] init_host_max_objects_retrieval = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] instance_format = [instance: %(uuid)s] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] iscsi_target_flags = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] iscsi_write_cache = on {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] iser_helper = tgtadm {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] iser_ip_address = 192.168.122.11 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] iser_port = 3260 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] log_color = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] log_config_append = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] log_dir = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] log_file = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] log_options = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] log_rotate_interval = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] log_rotate_interval_type = days {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] log_rotation_type = none {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] max_age = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] max_logfile_count = 30 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] max_logfile_size_mb = 200 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] max_over_subscription_ratio = 20.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] message_reap_interval = 86400 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] message_ttl = 2592000 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81244]: INFO cinder.volume.manager [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] migration_create_volume_timeout_secs = 300 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.remotefs [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81244) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] monkey_patch = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] monkey_patch_modules = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] my_ip = 192.168.122.11 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] no_snapshot_gb_quota = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] num_iser_scan_tries = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] num_shell_tries = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] num_volume_device_scan_tries = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] nvmeof_conn_info_version = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] nvmet_ns_id = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] nvmet_port_id = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] osapi_max_limit = 1000 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] osapi_volume_ext_list = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] osapi_volume_listen_port = 8776 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] osapi_volume_use_ssl = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] osapi_volume_workers = 2 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] per_volume_size_limit = -1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] periodic_fuzzy_delay = 60 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] periodic_interval = 60 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] public_endpoint = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] publish_errors = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] quota_backup_gigabytes = 1000 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] quota_backups = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] quota_gigabytes = 1000 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] quota_groups = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] quota_snapshots = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] quota_volumes = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] rate_limit_burst = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] rate_limit_except_level = CRITICAL {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] rate_limit_interval = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] reinit_driver_count = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] replication_device = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] report_discard_supported = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] report_interval = 120 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] reservation_clean_interval = 86400 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] reservation_expire = 86400 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] reserved_image_namespaces = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] reserved_percentage = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] rpc_response_timeout = 120 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] run_external_periodic_tasks = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] scst_target_driver = iscsi {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] scst_target_iqn_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_down_time = 720 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] shell_completion = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] snapshot_name_template = snapshot-%s {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] split_loggers = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] state_path = /opt/stack/data/cinder {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] storage_availability_zone = nova {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] storage_protocol = iSCSI {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] syslog_log_facility = LOG_USER {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] target_helper = lioadm {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] target_ip_address = 192.168.122.11 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] target_port = 3260 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] target_protocol = iscsi {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] target_secondary_ip_addresses = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] trace_flags = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] transport_url = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] until_refresh = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] use_chap_auth = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] use_default_quota_class = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] use_journal = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] use_json = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] use_multipath_for_image_xfer = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] use_stderr = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] use_syslog = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] verify_glance_signatures = enabled {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_api_class = cinder.volume.api.API {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_backend_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_clear = zero {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_clear_ionice = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_clear_size = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_copy_bps_limit = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_dd_blocksize = 1M {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_name_template = volume-%s {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_service_inithost_offload = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volume_usage_audit_period = month {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] zoning_mode = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_concurrency.disable_process_locking = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.admin_password = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.admin_token = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.admin_user = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.auth_port = 35357 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.auth_protocol = https {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.auth_section = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.auth_type = password {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.auth_uri = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.auth_version = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.cache = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.certfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.identity_uri = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.include_service_catalog = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.insecure = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.interface = public {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.keyfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_password = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcache_username = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.region_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.service_type = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.11/identity {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.backend = dogpile.cache.null {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.backend_argument = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.backend_expiration_time = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.config_prefix = cache.oslo {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.debug_cache_backend = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.enable_retry_client = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.enable_socket_keepalive = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.enabled = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.enforce_fips_mode = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.expiration_time = 600 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.hashclient_retry_attempts = 2 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.memcache_dead_retry = 300 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.memcache_pool_maxsize = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.memcache_sasl_enabled = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.password = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.proxies = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.redis_db = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.redis_server = localhost:6379 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.retry_attempts = 2 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81244) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.retry_delay = 0.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81244]: WARNING cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.socket_keepalive_count = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81244]: WARNING cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.socket_keepalive_idle = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.socket_keepalive_interval = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.socket_timeout = 1.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.tls_allowed_ciphers = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.tls_cafile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.tls_certfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.tls_enabled = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Running cmd (subprocess): mount.quobyte {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.tls_keyfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cache.username = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] coordination.backend_url = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.asyncio_connection = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.asyncio_slave_connection = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.backend = sqlalchemy {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.connection = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.connection_debug = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.connection_parameters = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.connection_recycle_time = 3600 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.connection_trace = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.db_inc_retry_interval = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.db_max_retries = 20 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.db_max_retry_interval = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.db_retry_interval = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.max_overflow = 50 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.max_pool_size = 5 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.max_retries = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.mysql_wsrep_sync_wait = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.pool_timeout = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.retry_interval = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.slave_connection = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.sqlite_synchronous = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.synchronous_reader = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] database.use_db_reconnect = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.connection_string = messaging:// {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.enabled = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.es_doc_type = notification {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.es_scroll_size = 10000 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.es_scroll_time = 2m {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.filter_error_trace = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.hmac_keys = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.sentinel_service_name = mymaster {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.socket_timeout = 0.1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.trace_requests = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler.trace_sqlalchemy = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler_jaeger.process_tags = {} {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler_jaeger.service_name_prefix = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] profiler_otlp.service_name_prefix = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.enforce_new_defaults = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: WARNING oslo_config.cfg [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.enforce_scope = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.policy_default_rule = default {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.policy_file = policy.yaml {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] privsep_osbrick.group = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] privsep_osbrick.helper_command = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] privsep_osbrick.user = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cinder_sys_admin.group = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cinder_sys_admin.helper_command = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] cinder_sys_admin.user = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.auth_section = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.auth_type = password {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.cafile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.certfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.collect_timing = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.insecure = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.keyfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.send_service_user_token = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.split_loggers = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] service_user.timeout = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.auth_section = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.auth_type = password {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:32 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.certfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.collect_timing = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.insecure = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.keyfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.region_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.split_loggers = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] glance.timeout = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.backend_availability_zone = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.chap_password = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.chap_username = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.disk_geometry = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.driver_client_cert = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.driver_client_cert_key = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.driver_data_namespace = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.driver_use_ssl = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.extra_capabilities = {} {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.filter_function = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.goodness_function = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.iscsi_target_flags = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.iscsi_write_cache = on {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.iser_helper = tgtadm {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.iser_port = 3260 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_host = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_login = admin {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_mount_options = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_password = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_private_key = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_share_path = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.num_shell_tries = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.quobyte_volume_url = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.replication_device = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.report_discard_supported = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.reserved_percentage = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.target_helper = tgtadm {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.target_port = 3260 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.target_protocol = iscsi {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.trace_flags = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.unique_fqdn_network = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.use_chap_auth = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.volume_backend_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.volume_clear = zero {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.volume_clear_ionice = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.volume_clear_size = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_reports.file_event_handler = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_reports.log_dir = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.backend_availability_zone = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.backend_host = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.chap_password = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.chap_username = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.chiscsi_conf = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.disk_geometry = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.driver_client_cert = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.driver_data_namespace = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.driver_use_ssl = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.extra_capabilities = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.filter_function = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.goodness_function = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.iser_helper = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.iser_ip_address = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.iser_port = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.iser_target_prefix = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_host = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_login = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_mount_options = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_password = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_private_key = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_share_path = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_ssh_port = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.num_shell_tries = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.nvmet_port_id = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.replication_device = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.report_discard_supported = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.reserved_percentage = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.scst_target_driver = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.storage_protocol = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.target_helper = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.target_ip_address = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.target_port = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.target_prefix = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.target_protocol = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.trace_flags = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.use_chap_auth = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.volume_clear = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.volume_clear_size = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] QuobyteHD.volumes_dir = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.ssl = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_notifications.driver = [] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_notifications.retry = -1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] key_manager.fixed_key = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.barbican_api_version = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.barbican_endpoint = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.barbican_endpoint_type = public {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.barbican_region_name = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.cafile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.certfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.collect_timing = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.insecure = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.keyfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.number_of_retries = 60 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.retry_delay = 1 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.send_service_user_token = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.split_loggers = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.timeout = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.verify_ssl = True {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican.verify_ssl_path = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican_service_user.auth_section = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican_service_user.auth_type = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican_service_user.cafile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican_service_user.certfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican_service_user.collect_timing = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican_service_user.insecure = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican_service_user.keyfile = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican_service_user.split_loggers = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] barbican_service_user.timeout = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.approle_role_id = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.approle_secret_id = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.kv_mountpoint = secret {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.kv_path = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.kv_version = 2 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.namespace = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.root_token_id = **** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.ssl_ca_crt_file = None {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.timeout = 60.0 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.use_ssl = False {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:33 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] ******************************************************************************** {{(pid=81086) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:50:33 devstack quobyte-client[81245]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 19:50:33 devstack quobyte-client[81245]: Invalid parameters found, error: missing mount point. Apr 24 19:50:33 devstack quobyte-client[81245]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 19:50:33 devstack quobyte-client[81245]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 19:50:33 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] CMD "mount.quobyte" returned: 1 in 0.136s {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:33 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:50:33 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:50:33 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:50:33 devstack cinder-volume[81244]: INFO cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 ... Apr 24 19:50:33 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 -c /etc/quobyte/client-cinder.cfg {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:33 devstack sudo[81246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 -c /etc/quobyte/client-cinder.cfg Apr 24 19:50:33 devstack sudo[81246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:33 devstack sudo[81246]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:33 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.515s {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:33 devstack cinder-volume[81244]: INFO cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 succeeded Apr 24 19:50:33 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:50:33 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.525s {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:50:33 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:33 devstack sudo[81315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:50:33 devstack sudo[81315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:34 devstack sudo[81315]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.396s {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:34 devstack cinder-volume[81244]: INFO cinder.volume.driver [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.volume.driver [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309837341309, 'free_capacity_gb': 1775.7309837341309, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81244) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_db.sqlalchemy.engines [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81244) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG dbcounter [-] [81244] Writer thread running {{(pid=81244) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.db.sqlalchemy.api [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Building query based on filter {{(pid=81244) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.image.image_utils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81244) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:50:34 devstack cinder-volume[81244]: INFO cinder.keymgr.migration [None req-edf62523-25f1-4add-b5c3-8a017c2dbcb5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:34 devstack sudo[81318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:50:34 devstack sudo[81318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:34 devstack sudo[81318]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.396s {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.manager [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Notifying Schedulers of capabilities ... {{(pid=81244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:50:34 devstack cinder-volume[81244]: INFO cinder.volume.manager [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Driver initialization completed successfully. Apr 24 19:50:34 devstack cinder-volume[81244]: INFO cinder.manager [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Initiating service 3 cleanup Apr 24 19:50:34 devstack cinder-volume[81244]: INFO cinder.manager [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Service 3 cleanup completed. Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.service [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Creating RPC server for service cinder-volume {{(pid=81244) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.service [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81244) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:50:34 devstack cinder-volume[81244]: INFO cinder.volume.manager [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:50:34 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:34 devstack sudo[81324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:50:34 devstack sudo[81324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:35 devstack sudo[81324]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:35 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.456s {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:35 devstack cinder-volume[81244]: INFO cinder.volume.manager [None req-dfcf457e-95a9-4674-960e-ed0c50426ff9 None None] Driver post RPC initialization completed successfully. Apr 24 19:50:38 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-37248b49-556d-4691-ac9b-3ce1c1340ecc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:50:38 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-37248b49-556d-4691-ac9b-3ce1c1340ecc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:50:38 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.quobyte [None req-37248b49-556d-4691-ac9b-3ce1c1340ecc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:50:38 devstack cinder-volume[81244]: DEBUG cinder.volume.drivers.quobyte [None req-37248b49-556d-4691-ac9b-3ce1c1340ecc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:50:38 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-37248b49-556d-4691-ac9b-3ce1c1340ecc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81244) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:50:38 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-37248b49-556d-4691-ac9b-3ce1c1340ecc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:38 devstack sudo[81389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:50:38 devstack sudo[81389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:38 devstack sudo[81389]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:38 devstack cinder-volume[81244]: DEBUG oslo_concurrency.processutils [None req-37248b49-556d-4691-ac9b-3ce1c1340ecc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.418s {{(pid=81244) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:38 devstack cinder-volume[81244]: DEBUG cinder.manager [None req-37248b49-556d-4691-ac9b-3ce1c1340ecc None None] Notifying Schedulers of capabilities ... {{(pid=81244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:50:42 devstack cinder-volume[81086]: INFO oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Caught SIGTERM, stopping children Apr 24 19:50:42 devstack cinder-volume[81086]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Acquiring lock "singleton_lock" {{(pid=81086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:50:42 devstack cinder-volume[81086]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Acquired lock "singleton_lock" {{(pid=81086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:50:42 devstack cinder-volume[81086]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Releasing lock "singleton_lock" {{(pid=81086) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:50:42 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Stop services. {{(pid=81086) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 19:50:42 devstack cinder-volume[81086]: DEBUG oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Killing children. {{(pid=81086) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 19:50:42 devstack cinder-volume[81086]: INFO oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Waiting on 1 children to exit Apr 24 19:50:42 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Acquiring lock "singleton_lock" {{(pid=81244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:50:42 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Acquired lock "singleton_lock" {{(pid=81244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:50:42 devstack cinder-volume[81244]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Releasing lock "singleton_lock" {{(pid=81244) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:50:42 devstack cinder-volume[81244]: WARNING amqp [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:50:42 devstack cinder-volume[81244]: WARNING amqp [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:50:42 devstack cinder-volume[81086]: INFO oslo_service.backend._eventlet.service [None req-2a1cbf60-1bc6-444e-9dbf-be65866f3518 None None] Child 81244 exited with status 0 Apr 24 19:50:43 devstack cinder-volume[81460]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:50:43 devstack cinder-volume[81460]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:50:43 devstack cinder-volume[81460]: we strongly recommend against using it for new projects. Apr 24 19:50:43 devstack cinder-volume[81460]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:50:43 devstack cinder-volume[81460]: framework. For more detail see Apr 24 19:50:43 devstack cinder-volume[81460]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:50:43 devstack cinder-volume[81460]: import eventlet # noqa Apr 24 19:50:45 devstack cinder-volume[81460]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81460) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:50:45 devstack cinder-volume[81460]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81460) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:50:45 devstack cinder-volume[81460]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81460) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:50:45 devstack cinder-volume[81460]: INFO dbcounter [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Registered counter for database cinder Apr 24 19:50:45 devstack cinder-volume[81460]: DEBUG oslo_db.sqlalchemy.engines [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81460) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG dbcounter [-] [81460] Writer thread running {{(pid=81460) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:50:46 devstack cinder-volume[81460]: INFO cinder.rpc [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:50:46 devstack cinder-volume[81460]: INFO cinder.rpc [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_db.sqlalchemy.engines [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81460) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:50:46 devstack cinder-volume[81460]: INFO cinder.volume.manager [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Determined volume DB was empty at startup. Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG cinder.volume.manager [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81460) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:50:46 devstack cinder-volume[81460]: WARNING stevedore.named [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:50:46 devstack cinder-volume[81460]: WARNING castellan.key_manager [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:50:46 devstack cinder-volume[81460]: WARNING cinder.keymgr.conf_key_mgr [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:50:46 devstack cinder-volume[81460]: INFO cinder.volume.manager [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_db.sqlalchemy.engines [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81460) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:50:46 devstack cinder-volume[81460]: INFO oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Starting 1 workers Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Started child 81641 {{(pid=81460) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Full set of CONF: {{(pid=81460) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] ******************************************************************************** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Configuration options gathered from: {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] ================================================================================ {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] allow_availability_zone_fallback = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] allow_compression_on_image_upload = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] allowed_direct_url_schemes = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] api_rate_limit = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] auth_strategy = keystone {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_availability_zone = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_host = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_stats_polling_interval = 60 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backup_api_class = cinder.backup.api.API {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backup_name_template = backup-%s {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backup_use_same_host = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backup_use_temp_snapshot = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] chap_password = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] chap_username = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cinder_internal_tenant_project_id = 1fa816bd5fe14ca49d080217d2782a1f {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cinder_internal_tenant_user_id = 62654c66acea4cf388920b8f8b0bbda9 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cluster = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] compression_format = gzip {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] compute_api_class = cinder.compute.nova.API {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] config_dir = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] config_source = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81641]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] control_exchange = openstack {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] debug = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] default_availability_zone = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] default_group_type = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] default_volume_type = QuobyteHD {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] disk_geometry = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] driver_client_cert = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] driver_client_cert_key = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] driver_data_namespace = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] driver_ssl_cert_path = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] driver_ssl_cert_verify = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] driver_use_ssl = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] enable_new_services = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] enable_unsupported_driver = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] enabled_backends = ['QuobyteHD'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] enforce_multipath_for_image_xfer = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] filter_function = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_api_insecure = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_api_servers = ['http://192.168.122.11/image'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_api_ssl_compression = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_ca_certificates_file = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_catalog_info = image:glance:publicURL {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_certfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_keyfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_num_retries = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance_request_timeout = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] goodness_function = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] graceful_shutdown_timeout = 5 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] group_api_class = cinder.group.api.API {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] host = devstack {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_compress_on_upload = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_conversion_address_space_limit = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_conversion_cpu_limit = 60 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_conversion_disable = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_upload_use_cinder_backend = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_upload_use_internal_tenant = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_volume_cache_enabled = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_volume_cache_max_count = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] image_volume_cache_max_size_gb = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] init_host_max_objects_retrieval = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] instance_format = [instance: %(uuid)s] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] iscsi_target_flags = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] iscsi_write_cache = on {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] iser_helper = tgtadm {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] iser_ip_address = 192.168.122.11 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] iser_port = 3260 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] log_color = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] log_config_append = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] log_dir = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] log_file = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] log_options = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] log_rotate_interval = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] log_rotate_interval_type = days {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] log_rotation_type = none {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] max_age = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] max_logfile_count = 30 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] max_logfile_size_mb = 200 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] max_over_subscription_ratio = 20.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] message_reap_interval = 86400 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] message_ttl = 2592000 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] migration_create_volume_timeout_secs = 300 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] monkey_patch = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] monkey_patch_modules = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] my_ip = 192.168.122.11 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] no_snapshot_gb_quota = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] num_iser_scan_tries = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] num_shell_tries = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] num_volume_device_scan_tries = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81641) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] nvmeof_conn_info_version = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] nvmet_ns_id = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] nvmet_port_id = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] osapi_max_limit = 1000 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] osapi_volume_ext_list = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] osapi_volume_listen = 0.0.0.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] osapi_volume_listen_port = 8776 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] osapi_volume_use_ssl = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] osapi_volume_workers = 2 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] per_volume_size_limit = -1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] periodic_fuzzy_delay = 60 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] periodic_interval = 60 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] project_id_regex = [0-9a-f\-]+ {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] public_endpoint = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] publish_errors = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] quota_backup_gigabytes = 1000 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] quota_backups = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] quota_gigabytes = 1000 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] quota_groups = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] quota_snapshots = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] quota_volumes = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] rate_limit_burst = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] rate_limit_except_level = CRITICAL {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] rate_limit_interval = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] reinit_driver_count = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] replication_device = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] report_discard_supported = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] report_interval = 120 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] reservation_clean_interval = 86400 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] reservation_expire = 86400 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] reserved_image_namespaces = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] reserved_percentage = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] rpc_response_timeout = 120 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] run_external_periodic_tasks = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] scst_target_driver = iscsi {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] scst_target_iqn_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_down_time = 720 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] shell_completion = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] snapshot_name_template = snapshot-%s {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] split_loggers = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] state_path = /opt/stack/data/cinder {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] storage_availability_zone = nova {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] storage_protocol = iSCSI {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] syslog_log_facility = LOG_USER {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] target_helper = lioadm {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] target_ip_address = 192.168.122.11 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] target_port = 3260 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] target_protocol = iscsi {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] target_secondary_ip_addresses = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] trace_flags = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] transfer_api_class = cinder.transfer.api.API {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] transport_url = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] until_refresh = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] use_chap_auth = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] use_default_quota_class = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] use_journal = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] use_json = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] use_multipath_for_image_xfer = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] use_stderr = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] use_syslog = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] verify_glance_signatures = enabled {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_api_class = cinder.volume.api.API {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_backend_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_clear = zero {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_clear_ionice = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_clear_size = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_copy_bps_limit = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_dd_blocksize = 1M {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_name_template = volume-%s {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_service_inithost_offload = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volume_usage_audit_period = month {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] zoning_mode = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_concurrency.disable_process_locking = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.admin_password = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.admin_token = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.admin_user = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.auth_admin_prefix = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.auth_port = 35357 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.auth_protocol = https {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.auth_section = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.auth_type = password {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.auth_uri = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.auth_version = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.cache = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.certfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.identity_uri = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.include_service_catalog = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.insecure = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.interface = public {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.keyfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_password = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcache_username = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.region_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.service_token_roles_required = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.service_type = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.11/identity {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.backend = dogpile.cache.null {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.backend_argument = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.backend_expiration_time = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.config_prefix = cache.oslo {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.debug_cache_backend = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.enable_retry_client = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.enable_socket_keepalive = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.enabled = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.enforce_fips_mode = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.expiration_time = 600 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.hashclient_retry_attempts = 2 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.memcache_dead_retry = 300 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.memcache_pool_maxsize = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.memcache_sasl_enabled = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.password = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81641) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 19:50:46 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.quobyte [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 19:50:46 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.quobyte [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Running cmd (subprocess): mount.quobyte {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.proxies = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.redis_db = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.redis_server = localhost:6379 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.retry_attempts = 2 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.retry_delay = 0.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.socket_keepalive_count = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.socket_keepalive_idle = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.socket_keepalive_interval = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.socket_timeout = 1.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.tls_allowed_ciphers = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.tls_cafile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.tls_certfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.tls_enabled = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.tls_keyfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cache.username = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] coordination.backend_url = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.asyncio_connection = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.asyncio_slave_connection = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.backend = sqlalchemy {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.connection = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.connection_debug = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.connection_parameters = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.connection_recycle_time = 3600 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.connection_trace = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.db_inc_retry_interval = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.db_max_retries = 20 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.db_max_retry_interval = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.db_retry_interval = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.max_overflow = 50 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.max_pool_size = 5 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.max_retries = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.mysql_wsrep_sync_wait = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.pool_timeout = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.retry_interval = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.slave_connection = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.sqlite_synchronous = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.synchronous_reader = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] database.use_db_reconnect = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.connection_string = messaging:// {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.enabled = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.es_doc_type = notification {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.es_scroll_size = 10000 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.es_scroll_time = 2m {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.filter_error_trace = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.hmac_keys = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.sentinel_service_name = mymaster {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.socket_timeout = 0.1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.trace_requests = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler.trace_sqlalchemy = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler_jaeger.process_tags = {} {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler_jaeger.service_name_prefix = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] profiler_otlp.service_name_prefix = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.enforce_new_defaults = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: WARNING oslo_config.cfg [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.enforce_scope = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.policy_default_rule = default {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.policy_file = policy.yaml {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_policy.remote_timeout = 60.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] privsep_osbrick.group = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] privsep_osbrick.helper_command = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] privsep_osbrick.user = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cinder_sys_admin.group = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cinder_sys_admin.helper_command = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] cinder_sys_admin.user = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.auth_section = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.auth_type = password {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.cafile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.certfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.collect_timing = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.insecure = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.keyfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.send_service_user_token = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.split_loggers = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] service_user.timeout = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.auth_section = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.auth_type = password {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.certfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.collect_timing = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.insecure = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.keyfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.region_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.split_loggers = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] glance.timeout = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.backend_availability_zone = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.chap_password = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.chap_username = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.disk_geometry = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.driver_client_cert = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.driver_client_cert_key = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.driver_data_namespace = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.driver_use_ssl = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.extra_capabilities = {} {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.filter_function = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.goodness_function = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.iscsi_target_flags = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.iscsi_write_cache = on {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.iser_helper = tgtadm {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.iser_port = 3260 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_host = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_login = admin {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_mount_options = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_password = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_private_key = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_share_path = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_ssh_port = 22 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.num_shell_tries = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.quobyte_client_cfg = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.quobyte_volume_url = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.replication_device = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.report_discard_supported = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.reserved_percentage = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.target_helper = tgtadm {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.target_port = 3260 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.target_protocol = iscsi {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.trace_flags = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.unique_fqdn_network = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.use_chap_auth = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.volume_backend_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.volume_clear = zero {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.volume_clear_ionice = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.volume_clear_size = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_reports.file_event_handler = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_reports.log_dir = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.backend_availability_zone = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.backend_host = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.chap_password = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.chap_username = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.chiscsi_conf = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.disk_geometry = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.driver_client_cert = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.driver_client_cert_key = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.driver_data_namespace = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.driver_use_ssl = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack sudo[81674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.extra_capabilities = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.filter_function = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.goodness_function = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack sudo[81674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.iscsi_target_flags = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.iscsi_write_cache = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.iser_helper = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.iser_ip_address = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.iser_port = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.iser_target_prefix = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_host = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_login = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_mount_options = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] CMD "mount.quobyte" returned: 1 in 0.154s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_password = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_private_key = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_share_path = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:50:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_ssh_port = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.num_shell_tries = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nvmet_ns_id = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.nvmet_port_id = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.replication_device = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.report_discard_supported = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.reserved_percentage = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.scst_target_driver = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.storage_protocol = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.target_helper = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.target_ip_address = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.target_port = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.target_prefix = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.target_protocol = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.trace_flags = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.unique_fqdn_network = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.use_chap_auth = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.volume_clear = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.volume_clear_ionice = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.volume_clear_size = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] QuobyteHD.volumes_dir = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.ssl = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.ssl_version = {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_notifications.driver = [] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_notifications.retry = -1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] key_manager.fixed_key = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.barbican_api_version = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.barbican_endpoint = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.barbican_endpoint_type = public {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.barbican_region_name = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.cafile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.certfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.collect_timing = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.insecure = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.keyfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.number_of_retries = 60 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.retry_delay = 1 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.send_service_user_token = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.split_loggers = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.timeout = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.verify_ssl = True {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican.verify_ssl_path = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican_service_user.auth_section = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican_service_user.auth_type = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican_service_user.cafile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican_service_user.certfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican_service_user.collect_timing = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican_service_user.insecure = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican_service_user.keyfile = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican_service_user.split_loggers = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] barbican_service_user.timeout = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.approle_role_id = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.approle_secret_id = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.kv_mountpoint = secret {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.kv_path = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.kv_version = 2 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.namespace = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.root_token_id = **** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.ssl_ca_crt_file = None {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.timeout = 60.0 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.use_ssl = False {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:50:46 devstack cinder-volume[81460]: DEBUG oslo_service.backend._eventlet.service [None req-169b89a4-5185-48c7-bc4d-7f27646a00fd None None] ******************************************************************************** {{(pid=81460) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:50:47 devstack sudo[81674]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.765s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:47 devstack cinder-volume[81641]: INFO cinder.volume.driver [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG cinder.volume.driver [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309837341309, 'free_capacity_gb': 1775.7309837341309, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81641) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG oslo_db.sqlalchemy.engines [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81641) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writer thread running {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG cinder.db.sqlalchemy.api [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Building query based on filter {{(pid=81641) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81641) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:50:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:47 devstack cinder-volume[81641]: INFO cinder.keymgr.migration [None req-74133e4d-bbf0-4112-8901-6dddede3409c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:50:47 devstack sudo[81730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:50:47 devstack sudo[81730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.648s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:50:48 devstack sudo[81730]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:48 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Driver initialization completed successfully. Apr 24 19:50:48 devstack cinder-volume[81641]: INFO cinder.manager [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Initiating service 3 cleanup Apr 24 19:50:48 devstack cinder-volume[81641]: INFO cinder.manager [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Service 3 cleanup completed. Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG cinder.service [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Creating RPC server for service cinder-volume {{(pid=81641) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG cinder.service [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81641) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:50:48 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:50:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:50:48 devstack sudo[81749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:50:48 devstack sudo[81749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:50:49 devstack sudo[81749]: pam_unix(sudo:session): session closed for user root Apr 24 19:50:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.483s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:50:49 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-59d86c2a-e719-4bf3-aa8c-732631811fec None None] Driver post RPC initialization completed successfully. Apr 24 19:50:56 devstack cinder-volume[81460]: DEBUG dbcounter [-] [81460] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81460) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:50:58 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:50:59 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=2 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:51:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:51:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:51:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:51:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:51:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:51:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:51:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:51:53 devstack sudo[82071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:51:53 devstack sudo[82071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:51:53 devstack sudo[82071]: pam_unix(sudo:session): session closed for user root Apr 24 19:51:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.817s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:51:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Flow 'volume_create_manager' (c0005a67-ca15-4a61-8282-9c419bc9808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1383c2c5-d7a3-40e0-aea8-0486565fb238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1383c2c5-d7a3-40e0-aea8-0486565fb238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-633211628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3889fdf0-65a1-4745-83e5-b866de3de96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88addf47856246bebb15786a316856b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:05Z,use_quota=True,user_id='bec3d31159144eccbbad0d19a6335ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49ab35e-f8ec-4187-af73-906ff257d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49ab35e-f8ec-4187-af73-906ff257d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ac6bfd-f69c-4aec-9060-902a9a0bbbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ac6bfd-f69c-4aec-9060-902a9a0bbbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3889fdf0-65a1-4745-83e5-b866de3de96e', 'volume_name': 'volume-3889fdf0-65a1-4745-83e5-b866de3de96e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5494cb9a-3991-460a-a13a-31705c5cf9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5494cb9a-3991-460a-a13a-31705c5cf9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad581201-d659-4516-995f-a80177f60ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:04 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Volume 3889fdf0-65a1-4745-83e5-b866de3de96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3889fdf0-65a1-4745-83e5-b866de3de96e', 'volume_size': 1} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-633211628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3889fdf0-65a1-4745-83e5-b866de3de96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88addf47856246bebb15786a316856b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:05Z,use_quota=True,user_id='bec3d31159144eccbbad0d19a6335ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Creating volume 3889fdf0-65a1-4745-83e5-b866de3de96e {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:52:04 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:52:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:05 devstack sudo[82234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e 1073741824 Apr 24 19:52:05 devstack sudo[82234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:06 devstack sudo[82234]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e 1073741824" returned: 0 in 2.009s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:07 devstack sudo[82563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e Apr 24 19:52:07 devstack sudo[82563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:08 devstack sudo[82563]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e" returned: 0 in 1.247s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] <== create_volume: return (3340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:52:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.350s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad581201-d659-4516-995f-a80177f60ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3889fdf0-65a1-4745-83e5-b866de3de96e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ce01b2-ec72-4e04-b6d1-03492de928cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:08 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Volume volume-3889fdf0-65a1-4745-83e5-b866de3de96e (3889fdf0-65a1-4745-83e5-b866de3de96e): created successfully Apr 24 19:52:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ce01b2-ec72-4e04-b6d1-03492de928cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Flow 'volume_create_manager' (c0005a67-ca15-4a61-8282-9c419bc9808f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:08 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-ce1caecc-3391-4456-b590-c1bed1e31656 tempest-DeleteServersTestJSON-416770251 None] Created volume successfully. Apr 24 19:52:17 devstack cinder-volume[81641]: WARNING py.warnings [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 24 19:52:17 devstack cinder-volume[81641]: .first() Apr 24 19:52:17 devstack cinder-volume[81641]: Apr 24 19:52:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:17 devstack cinder-volume[81641]: INFO oslo.privsep.daemon [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpven1p3_z/privsep.sock'] Apr 24 19:52:17 devstack sudo[82761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpven1p3_z/privsep.sock Apr 24 19:52:17 devstack sudo[82761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:18 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 24 19:52:18 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:52:18 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 19:52:18 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:52:18 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:52:18 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 19:52:18 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:52:18 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:52:18 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Flow 'volume_create_manager' (88cde2e7-b353-4267-9576-815d19869f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487310ce-fdbf-461e-8a1f-a696c6022737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487310ce-fdbf-461e-8a1f-a696c6022737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1809867592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0666ece-68ed-4bc2-a98b-2f3da9c82bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3d8cba1165442baca6bbbcdeb15f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:19Z,use_quota=True,user_id='8b6abc1b60e94fa8a6b27a2cd5290063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6e5345-b9f1-4be6-8e63-7f4940b8a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6e5345-b9f1-4be6-8e63-7f4940b8a313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79040a1a-7dd9-4a51-9dbb-0c35c9d2d764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79040a1a-7dd9-4a51-9dbb-0c35c9d2d764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0666ece-68ed-4bc2-a98b-2f3da9c82bd4', 'volume_name': 'volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecbc835-10c1-45ff-be45-7c61177f7460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecbc835-10c1-45ff-be45-7c61177f7460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d303f2-8b30-47bc-922b-28787508fed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:18 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Volume c0666ece-68ed-4bc2-a98b-2f3da9c82bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4', 'volume_size': 1} Apr 24 19:52:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:19 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 24 19:52:19 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:52:19 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 19:52:19 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:52:19 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:52:19 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 19:52:19 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:52:19 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:52:19 devstack cinder-volume[81641]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 24 19:52:19 devstack sudo[82761]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:19 devstack cinder-volume[81641]: INFO oslo.privsep.daemon [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] Spawned new privsep daemon via rootwrap Apr 24 19:52:19 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] Accepted privsep connection to /tmp/tmpven1p3_z/privsep.sock {{(pid=81641) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 24 19:52:19 devstack cinder-volume[81641]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 24 19:52:19 devstack cinder-volume[81641]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 24 19:52:19 devstack cinder-volume[81641]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 24 19:52:19 devstack cinder-volume[81641]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82766 Apr 24 19:52:19 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8538962-dc22-48cf-8720-17dd58728780]: (2,) {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:52:19 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c69eaca-59e0-48fe-a5e3-1d1a5ad25384]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:52:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:19 devstack sudo[82768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e Apr 24 19:52:19 devstack sudo[82768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:20 devstack sudo[82768]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e" returned: 0 in 0.820s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.633s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1809867592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0666ece-68ed-4bc2-a98b-2f3da9c82bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3d8cba1165442baca6bbbcdeb15f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:19Z,use_quota=True,user_id='8b6abc1b60e94fa8a6b27a2cd5290063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Creating volume c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:52:20 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:20 devstack sudo[82773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 1073741824 Apr 24 19:52:20 devstack sudo[82773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843', 'name': 'volume-3889fdf0-65a1-4745-83e5-b866de3de96e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e77fd65e-f474-4169-aa43-c1ea28da7bfa', 'enforce_multipath': True} {{(pid=81641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:52:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-9cf52723-7675-4914-87d3-46f75ea18f6c req-004958e5-b4cd-40c2-ac2e-dd3650e49a88 tempest-DeleteServersTestJSON-416770251 None] attachment_update completed successfully. Apr 24 19:52:21 devstack sudo[82773]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 1073741824" returned: 0 in 1.089s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:21 devstack sudo[82783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 Apr 24 19:52:21 devstack sudo[82783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:22 devstack sudo[82783]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4" returned: 0 in 0.810s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:52:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d303f2-8b30-47bc-922b-28787508fed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5783e90-e15d-4cb2-8bc2-320828e3e2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:22 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Volume volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 (c0666ece-68ed-4bc2-a98b-2f3da9c82bd4): created successfully Apr 24 19:52:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5783e90-e15d-4cb2-8bc2-320828e3e2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Flow 'volume_create_manager' (88cde2e7-b353-4267-9576-815d19869f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:22 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1355155f-2c77-4411-852d-22ee67fcab8d tempest-VolumesAdminNegativeTest-922312562 None] Created volume successfully. Apr 24 19:52:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Acquiring lock "cinder-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:52:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Lock "cinder-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:52:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Acquiring lock "cinder-quobyte-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:52:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Lock "cinder-quobyte-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4" acquired by "delete_volume" :: waited 0.043s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:52:23 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[40705a64-171e-4445-86f6-1208524df3a5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:52:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:24 devstack sudo[83182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 Apr 24 19:52:24 devstack sudo[83182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:25 devstack sudo[83182]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4" returned: 0 in 1.312s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:25 devstack sudo[83242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4 Apr 24 19:52:25 devstack sudo[83242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:25 devstack sudo[83242]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4" returned: 0 in 0.622s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Lock "cinder-quobyte-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4" released by "delete_volume" :: held 2.011s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:52:25 devstack cinder-volume[81641]: WARNING cinder.quota [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:52:25 devstack cinder-volume[81641]: WARNING cinder.quota [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:52:25 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Created reservations ['b20c620f-51d1-4032-8d0c-55429abfaf4f', '2b0799cd-28bd-4d3a-a268-ff38380e0d25', '391b56ea-8b7a-403d-aaf8-357bb815de23', '996d7c5d-7288-42e9-b7af-0ab9b0f1fb8d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:52:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:26 devstack sudo[83256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:52:26 devstack sudo[83256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:27 devstack sudo[83256]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.046s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:27 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:52:27 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Deleted volume successfully. Apr 24 19:52:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-84ba0d61-94e1-47e6-a369-8288f2327e8a tempest-VolumesAdminNegativeTest-922312562 None] Lock "cinder-c0666ece-68ed-4bc2-a98b-2f3da9c82bd4-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:52:32 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-e2d0b415-2ba6-44a8-a28c-9c796c95ad8f req-83420046-a7e3-4b1a-952f-ec04eb93bab7 tempest-DeleteServersTestJSON-416770251 None] Terminate volume connection completed successfully. Apr 24 19:52:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-e2d0b415-2ba6-44a8-a28c-9c796c95ad8f req-83420046-a7e3-4b1a-952f-ec04eb93bab7 tempest-DeleteServersTestJSON-416770251 None] Deleting attachment e77fd65e-f474-4169-aa43-c1ea28da7bfa. {{(pid=81641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:52:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Acquiring lock "cinder-3889fdf0-65a1-4745-83e5-b866de3de96e-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:52:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Lock "cinder-3889fdf0-65a1-4745-83e5-b866de3de96e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:52:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Acquiring lock "cinder-quobyte-3889fdf0-65a1-4745-83e5-b866de3de96e" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:52:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Lock "cinder-quobyte-3889fdf0-65a1-4745-83e5-b866de3de96e" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:52:37 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f39ab79-e08a-404e-bb57-eadad5ab2c2b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:52:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:37 devstack sudo[83417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e Apr 24 19:52:37 devstack sudo[83417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:37 devstack sudo[83417]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e" returned: 0 in 0.624s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:37 devstack sudo[83423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e Apr 24 19:52:37 devstack sudo[83423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:38 devstack sudo[83423]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3889fdf0-65a1-4745-83e5-b866de3de96e" returned: 0 in 0.587s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Lock "cinder-quobyte-3889fdf0-65a1-4745-83e5-b866de3de96e" released by "delete_volume" :: held 1.262s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:52:38 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Created reservations ['d5260565-ad18-4a23-a7c6-bebc4d4a2cc6', '59e064e7-0f0a-4c12-ab4e-daa8f4241226', '2b48548e-8b1a-450e-807d-075ff3d1b571', 'f9290f70-3c43-42e6-869f-e388b58a8bad'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:52:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:38 devstack sudo[83430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:52:38 devstack sudo[83430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:39 devstack sudo[83430]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.544s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:39 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:52:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Deleted volume successfully. Apr 24 19:52:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-33d1f95c-8be4-4535-8597-bd293ee16241 tempest-DeleteServersTestJSON-416770251 None] Lock "cinder-3889fdf0-65a1-4745-83e5-b866de3de96e-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Flow 'volume_create_manager' (93583ec1-f890-48f2-a3f5-409139bd364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a46df3-078b-4292-b18f-dcf49fdbd4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a46df3-078b-4292-b18f-dcf49fdbd4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-945145506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eac016d-eaa9-4ce6-a429-e53c9069a1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696f4a5d22dd440487a66d7a907c9efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:45Z,use_quota=True,user_id='45686c3d0fbe4376962c4cb8550ce1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d498e20a-8493-47a8-8dc7-5816fb2efdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d498e20a-8493-47a8-8dc7-5816fb2efdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafb1c61-0418-47bb-ab51-821a2554e0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafb1c61-0418-47bb-ab51-821a2554e0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eac016d-eaa9-4ce6-a429-e53c9069a1ce', 'volume_name': 'volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b180cd-ba0c-4dc9-9fa8-31f1777224a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b180cd-ba0c-4dc9-9fa8-31f1777224a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25e891a-105d-4286-88a4-7398a84bfb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Volume 9eac016d-eaa9-4ce6-a429-e53c9069a1ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce', 'volume_size': 1} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-945145506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eac016d-eaa9-4ce6-a429-e53c9069a1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696f4a5d22dd440487a66d7a907c9efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:45Z,use_quota=True,user_id='45686c3d0fbe4376962c4cb8550ce1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Creating volume 9eac016d-eaa9-4ce6-a429-e53c9069a1ce {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:52:45 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:52:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:45 devstack sudo[83492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce 1073741824 Apr 24 19:52:45 devstack sudo[83492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:46 devstack sudo[83492]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce 1073741824" returned: 0 in 1.350s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:46 devstack sudo[83500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce Apr 24 19:52:46 devstack sudo[83500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:47 devstack sudo[83500]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce" returned: 0 in 0.826s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:52:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25e891a-105d-4286-88a4-7398a84bfb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8d7a3d-7b97-4d95-8efc-0ae323c6cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:47 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Volume volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce (9eac016d-eaa9-4ce6-a429-e53c9069a1ce): created successfully Apr 24 19:52:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea8d7a3d-7b97-4d95-8efc-0ae323c6cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Flow 'volume_create_manager' (93583ec1-f890-48f2-a3f5-409139bd364d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:47 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-120661f7-16b5-4506-9725-01d90eb05fce tempest-ServersNegativeTestJSON-1038905527 None] Created volume successfully. Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Flow 'volume_create_manager' (739f0c06-8108-4291-9ac6-bec17a887f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a1b386-507a-4e56-8d4d-c4e2754a856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a1b386-507a-4e56-8d4d-c4e2754a856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1963848778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dd0016-d908-4d72-9e49-49159dcae8bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6c013755f5e4507803ab4fdba395629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:50Z,use_quota=True,user_id='74ed38182a1d4295b4495c481fcc21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7180f2-925d-4c9e-a15c-6779b3db2d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7180f2-925d-4c9e-a15c-6779b3db2d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d743348a-3a4f-42a4-a3b8-533c11f6bf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d743348a-3a4f-42a4-a3b8-533c11f6bf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39dd0016-d908-4d72-9e49-49159dcae8bd', 'volume_name': 'volume-39dd0016-d908-4d72-9e49-49159dcae8bd', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb9ad03-a0a8-4061-bf5e-99db4ddfa668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb9ad03-a0a8-4061-bf5e-99db4ddfa668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77eb36b0-2bd9-4dfb-877d-0c9d66468792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Volume 39dd0016-d908-4d72-9e49-49159dcae8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39dd0016-d908-4d72-9e49-49159dcae8bd', 'volume_size': 1} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1963848778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dd0016-d908-4d72-9e49-49159dcae8bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6c013755f5e4507803ab4fdba395629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:50Z,use_quota=True,user_id='74ed38182a1d4295b4495c481fcc21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Creating volume 39dd0016-d908-4d72-9e49-49159dcae8bd {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:52:50 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:50 devstack sudo[83509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd 1073741824 Apr 24 19:52:50 devstack sudo[83509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Flow 'volume_create_manager' (e2d06d1e-382e-4d65-9cf2-9e8676ef7ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48146ae3-8127-42a4-88ea-17eaf679fe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48146ae3-8127-42a4-88ea-17eaf679fe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2015167832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d4576b-dd6d-4834-a749-f27a5aa81bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696f4a5d22dd440487a66d7a907c9efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:50Z,use_quota=True,user_id='45686c3d0fbe4376962c4cb8550ce1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5f11b8-ce94-4e48-b582-7ae66fa36b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5f11b8-ce94-4e48-b582-7ae66fa36b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8a9075-cfe4-4a52-a730-625d05174be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8a9075-cfe4-4a52-a730-625d05174be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d4576b-dd6d-4834-a749-f27a5aa81bb3', 'volume_name': 'volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbedec5-23b4-42f8-8ac1-a25d01c98dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbedec5-23b4-42f8-8ac1-a25d01c98dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd1f8ad-73d9-4883-9a72-8e25b6972784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:50 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Volume 85d4576b-dd6d-4834-a749-f27a5aa81bb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3', 'volume_size': 1} Apr 24 19:52:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:51 devstack sudo[83509]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd 1073741824" returned: 0 in 0.901s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:51 devstack sudo[83515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd Apr 24 19:52:51 devstack sudo[83515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:51 devstack sudo[83515]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd" returned: 0 in 0.565s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2015167832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d4576b-dd6d-4834-a749-f27a5aa81bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696f4a5d22dd440487a66d7a907c9efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:50Z,use_quota=True,user_id='45686c3d0fbe4376962c4cb8550ce1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Creating volume 85d4576b-dd6d-4834-a749-f27a5aa81bb3 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:52:51 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77eb36b0-2bd9-4dfb-877d-0c9d66468792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39dd0016-d908-4d72-9e49-49159dcae8bd', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a031a856-1cd9-44c4-a0df-e68eb41c6567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:51 devstack sudo[83519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 1073741824 Apr 24 19:52:51 devstack sudo[83519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:51 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Volume volume-39dd0016-d908-4d72-9e49-49159dcae8bd (39dd0016-d908-4d72-9e49-49159dcae8bd): created successfully Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a031a856-1cd9-44c4-a0df-e68eb41c6567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Flow 'volume_create_manager' (739f0c06-8108-4291-9ac6-bec17a887f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:51 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-bd37fde0-5d0c-44a5-b7ef-7a9ddf325caf tempest-VolumesTestJSON-1323790132 None] Created volume successfully. Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:52:53 devstack sudo[83519]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Flow 'volume_create_manager' (730a3660-eee4-4c5c-afc4-7dd70444d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de076dc3-1b4b-4d9c-9de1-c6833af3b34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:53 devstack sudo[83547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:52:53 devstack sudo[83547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de076dc3-1b4b-4d9c-9de1-c6833af3b34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-92535736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1629b24c-c735-46c4-b6b1-b7c7f5926cb9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6c013755f5e4507803ab4fdba395629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:53Z,use_quota=True,user_id='74ed38182a1d4295b4495c481fcc21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d4ce46-6d11-434e-b572-4580d4934ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d4ce46-6d11-434e-b572-4580d4934ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70437f47-9354-4426-8534-cdce6275728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70437f47-9354-4426-8534-cdce6275728f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1629b24c-c735-46c4-b6b1-b7c7f5926cb9', 'volume_name': 'volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c418416-5891-4d84-ac14-e327bb16e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c418416-5891-4d84-ac14-e327bb16e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2af6742-a3db-4853-8985-5dde961fece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:53 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Volume 1629b24c-c735-46c4-b6b1-b7c7f5926cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9', 'volume_size': 1} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 1073741824" returned: 0 in 1.551s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:53 devstack sudo[83551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 Apr 24 19:52:53 devstack sudo[83551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:53 devstack sudo[83547]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.739s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:52:54 devstack sudo[83551]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3" returned: 0 in 1.009s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] <== create_volume: return (2655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.658s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-92535736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1629b24c-c735-46c4-b6b1-b7c7f5926cb9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6c013755f5e4507803ab4fdba395629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:53Z,use_quota=True,user_id='74ed38182a1d4295b4495c481fcc21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Creating volume 1629b24c-c735-46c4-b6b1-b7c7f5926cb9 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:52:54 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd1f8ad-73d9-4883-9a72-8e25b6972784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a68b6f-61b3-421d-b856-fa34c2728776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:54 devstack sudo[83571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 1073741824 Apr 24 19:52:54 devstack sudo[83571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Volume volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 (85d4576b-dd6d-4834-a749-f27a5aa81bb3): created successfully Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a68b6f-61b3-421d-b856-fa34c2728776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Flow 'volume_create_manager' (e2d06d1e-382e-4d65-9cf2-9e8676ef7ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:54 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8db03c41-5afe-4a18-bee5-68416446e66f tempest-ServersNegativeTestJSON-1038905527 None] Created volume successfully. Apr 24 19:52:55 devstack sudo[83571]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 1073741824" returned: 0 in 0.841s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:55 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 Apr 24 19:52:55 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:55 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9" returned: 0 in 0.699s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:52:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2af6742-a3db-4853-8985-5dde961fece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68fa952-75e6-479f-9b5e-8485c3731729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:56 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Volume volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 (1629b24c-c735-46c4-b6b1-b7c7f5926cb9): created successfully Apr 24 19:52:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68fa952-75e6-479f-9b5e-8485c3731729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Flow 'volume_create_manager' (730a3660-eee4-4c5c-afc4-7dd70444d485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-05077699-21b9-4125-91ca-c7504d6ff5f0 tempest-VolumesTestJSON-1323790132 None] Created volume successfully. Apr 24 19:52:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "cinder-85d4576b-dd6d-4834-a749-f27a5aa81bb3-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:52:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Lock "cinder-85d4576b-dd6d-4834-a749-f27a5aa81bb3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:52:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "cinder-quobyte-85d4576b-dd6d-4834-a749-f27a5aa81bb3" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:52:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Lock "cinder-quobyte-85d4576b-dd6d-4834-a749-f27a5aa81bb3" acquired by "delete_volume" :: waited 0.028s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:52:56 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f2080-dfcd-4aa7-b8da-e99db3fe2207]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:52:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:56 devstack sudo[83622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 Apr 24 19:52:56 devstack sudo[83622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Flow 'volume_create_manager' (2075b3ca-4bc2-4e9c-b742-bc38d757429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8330f4c2-1549-41fd-8875-1e62c0b829ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8330f4c2-1549-41fd-8875-1e62c0b829ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2145640271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8fbaa2-2f94-436d-9460-cc75ad4f874a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6c013755f5e4507803ab4fdba395629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:57Z,use_quota=True,user_id='74ed38182a1d4295b4495c481fcc21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cff2cf2-754c-493f-8665-be0782670bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cff2cf2-754c-493f-8665-be0782670bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca96d676-986d-4c79-b8ef-5abf403fc743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca96d676-986d-4c79-b8ef-5abf403fc743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8fbaa2-2f94-436d-9460-cc75ad4f874a', 'volume_name': 'volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade893f6-39b1-4e3b-93b3-b2a1554206f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade893f6-39b1-4e3b-93b3-b2a1554206f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f1ce69-86a0-4429-a55f-3398ddca0098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:57 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Volume 3b8fbaa2-2f94-436d-9460-cc75ad4f874a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a', 'volume_size': 1} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2145640271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8fbaa2-2f94-436d-9460-cc75ad4f874a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6c013755f5e4507803ab4fdba395629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:52:57Z,use_quota=True,user_id='74ed38182a1d4295b4495c481fcc21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Creating volume 3b8fbaa2-2f94-436d-9460-cc75ad4f874a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:52:57 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:57 devstack sudo[83627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a 1073741824 Apr 24 19:52:57 devstack sudo[83627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:57 devstack sudo[83622]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3" returned: 0 in 0.789s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:57 devstack sudo[83630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3 Apr 24 19:52:57 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:57 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85d4576b-dd6d-4834-a749-f27a5aa81bb3" returned: 0 in 0.594s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Lock "cinder-quobyte-85d4576b-dd6d-4834-a749-f27a5aa81bb3" released by "delete_volume" :: held 1.448s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:52:58 devstack sudo[83627]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a 1073741824" returned: 0 in 0.778s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Created reservations ['6d3b19a3-570f-43c1-a27a-1087db63590d', '71f4bf96-49d9-4648-a646-5aa46e91ef8c', '363837df-839a-4222-82c0-3129774c0175', '52f82029-797d-4463-814e-3e9f2599a849'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:58 devstack sudo[83637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a Apr 24 19:52:58 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:58 devstack sudo[83639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:52:58 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:58 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a" returned: 0 in 0.532s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f1ce69-86a0-4429-a55f-3398ddca0098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa31bf4a-54ac-4d11-b96b-3c7f3680915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=37,cinder:UPDATE=47,cinder:INSERT=14,cinder:DELETE=4 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:52:58 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:58 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Volume volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a (3b8fbaa2-2f94-436d-9460-cc75ad4f874a): created successfully Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa31bf4a-54ac-4d11-b96b-3c7f3680915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Flow 'volume_create_manager' (2075b3ca-4bc2-4e9c-b742-bc38d757429d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.505s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:52:58 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Deleted volume successfully. Apr 24 19:52:58 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b8d34573-2725-4160-a28a-6bfa1879eb7b tempest-VolumesTestJSON-1323790132 None] Created volume successfully. Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ed64de1e-3a66-4d9c-b5a0-bcd75c0f95fc tempest-ServersNegativeTestJSON-1038905527 None] Lock "cinder-85d4576b-dd6d-4834-a749-f27a5aa81bb3-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "cinder-9eac016d-eaa9-4ce6-a429-e53c9069a1ce-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Lock "cinder-9eac016d-eaa9-4ce6-a429-e53c9069a1ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "cinder-quobyte-9eac016d-eaa9-4ce6-a429-e53c9069a1ce" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Lock "cinder-quobyte-9eac016d-eaa9-4ce6-a429-e53c9069a1ce" acquired by "delete_volume" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8724ba9e-38c3-4589-8cce-f290ee7f344e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:52:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:59 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce Apr 24 19:52:59 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:52:59 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Apr 24 19:52:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce" returned: 0 in 0.713s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:52:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:52:59 devstack sudo[83648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce Apr 24 19:52:59 devstack sudo[83648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:00 devstack sudo[83648]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9eac016d-eaa9-4ce6-a429-e53c9069a1ce" returned: 0 in 0.621s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Lock "cinder-quobyte-9eac016d-eaa9-4ce6-a429-e53c9069a1ce" released by "delete_volume" :: held 1.395s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:UPDATE=48,cinder:SELECT=36,cinder:INSERT=5,cinder:DELETE=5 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Created reservations ['eacaacc2-49be-4c79-86db-796c3f8ad338', '8f3a0c4b-e524-4a64-a17f-16829c7133b6', '8743c938-11f8-4797-b92d-1cfbb0197341', '0c2ec95c-f305-460a-90ad-6d70941a99d3'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:00 devstack sudo[83655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:53:00 devstack sudo[83655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Acquiring lock "cinder-3b8fbaa2-2f94-436d-9460-cc75ad4f874a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Lock "cinder-3b8fbaa2-2f94-436d-9460-cc75ad4f874a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Acquiring lock "cinder-quobyte-3b8fbaa2-2f94-436d-9460-cc75ad4f874a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Lock "cinder-quobyte-3b8fbaa2-2f94-436d-9460-cc75ad4f874a" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c82d9f-1152-414f-832c-f11f67cace2c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:00 devstack sudo[83657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a Apr 24 19:53:00 devstack sudo[83657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:01 devstack sudo[83655]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.809s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:01 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:53:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Deleted volume successfully. Apr 24 19:53:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dca6b018-f582-40e8-9ce2-10ddf51e3ed1 tempest-ServersNegativeTestJSON-1038905527 None] Lock "cinder-9eac016d-eaa9-4ce6-a429-e53c9069a1ce-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:01 devstack sudo[83657]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a" returned: 0 in 0.863s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:01 devstack sudo[83666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a Apr 24 19:53:01 devstack sudo[83666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:02 devstack sudo[83666]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3b8fbaa2-2f94-436d-9460-cc75ad4f874a" returned: 0 in 0.595s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Lock "cinder-quobyte-3b8fbaa2-2f94-436d-9460-cc75ad4f874a" released by "delete_volume" :: held 1.502s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:02 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Created reservations ['09d5b4c6-1549-4e0b-94cd-aad1396a9b37', '0ebd5329-8b64-4337-b52f-414919ace46f', '0a22af7e-e03a-4255-8387-0396637568e2', '23a27689-901d-4e8d-af3e-0a0300d0167b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:53:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:02 devstack sudo[83669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:53:02 devstack sudo[83669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Acquiring lock "cinder-1629b24c-c735-46c4-b6b1-b7c7f5926cb9-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Lock "cinder-1629b24c-c735-46c4-b6b1-b7c7f5926cb9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Acquiring lock "cinder-quobyte-1629b24c-c735-46c4-b6b1-b7c7f5926cb9" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:03 devstack sudo[83669]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Lock "cinder-quobyte-1629b24c-c735-46c4-b6b1-b7c7f5926cb9" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.800s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:53:03 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Deleted volume successfully. Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383d30e-d9be-4bbf-bc44-3d4a4ff62a74]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-65d0f4f8-c8a1-4452-98dd-c91101a0b08f tempest-VolumesTestJSON-1323790132 None] Lock "cinder-3b8fbaa2-2f94-436d-9460-cc75ad4f874a-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:03 devstack sudo[83701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 Apr 24 19:53:03 devstack sudo[83701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:03 devstack sudo[83701]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9" returned: 0 in 0.839s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:04 devstack sudo[83707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9 Apr 24 19:53:04 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:04 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1629b24c-c735-46c4-b6b1-b7c7f5926cb9" returned: 0 in 0.590s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Lock "cinder-quobyte-1629b24c-c735-46c4-b6b1-b7c7f5926cb9" released by "delete_volume" :: held 1.501s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Created reservations ['310ea655-d9ae-446b-8d95-47336f084ccd', '12f6a6af-163c-45ab-b104-39ba0067cebf', 'e2c608af-7195-44a6-9826-b43c30120e4a', 'bd36bed2-ec81-47d3-8e8a-ea1669a18e87'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:04 devstack sudo[83712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:53:04 devstack sudo[83712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:05 devstack sudo[83712]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Acquiring lock "cinder-39dd0016-d908-4d72-9e49-49159dcae8bd-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.601s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:05 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:53:05 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Deleted volume successfully. Apr 24 19:53:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Lock "cinder-39dd0016-d908-4d72-9e49-49159dcae8bd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fde67e3b-5e1a-4da5-9af0-a4c6e67481a1 tempest-VolumesTestJSON-1323790132 None] Lock "cinder-1629b24c-c735-46c4-b6b1-b7c7f5926cb9-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Acquiring lock "cinder-quobyte-39dd0016-d908-4d72-9e49-49159dcae8bd" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Lock "cinder-quobyte-39dd0016-d908-4d72-9e49-49159dcae8bd" acquired by "delete_volume" :: waited 0.031s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:05 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f76a43-0f30-401a-a182-e4ad8a7ccaff]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:05 devstack sudo[83722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd Apr 24 19:53:05 devstack sudo[83722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:06 devstack sudo[83722]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd" returned: 0 in 0.984s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:06 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd Apr 24 19:53:06 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Flow 'volume_create_manager' (5a758a19-fdd5-43f2-ac7e-436e616b8a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5eee3a-3f5b-4344-8993-95c348436ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5eee3a-3f5b-4344-8993-95c348436ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:53:07Z,deleted=False,deleted_at=None,display_description='',display_name='0165c875-21cf-41b4-8d14-be3766aa6f5c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e437374-623d-4fd2-b31e-6464d3d796d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a241b083e843a6bc4da936f75cd2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:07Z,use_quota=True,user_id='af01dc984ac24fabbaf72e174f04a3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75c7781-0821-43ff-8cbb-b93584e0d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75c7781-0821-43ff-8cbb-b93584e0d852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380068ea-fe17-4222-a2cc-ea1b214cd1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380068ea-fe17-4222-a2cc-ea1b214cd1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e437374-623d-4fd2-b31e-6464d3d796d5', 'volume_name': 'volume-7e437374-623d-4fd2-b31e-6464d3d796d5', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dca9e9-fc7a-4df9-9610-31021328a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dca9e9-fc7a-4df9-9610-31021328a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c985aa6-5a44-4080-8d74-02e89b1d5917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:07 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Volume 7e437374-623d-4fd2-b31e-6464d3d796d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e437374-623d-4fd2-b31e-6464d3d796d5', 'volume_size': 1} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:53:07Z,deleted=False,deleted_at=None,display_description='',display_name='0165c875-21cf-41b4-8d14-be3766aa6f5c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e437374-623d-4fd2-b31e-6464d3d796d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a241b083e843a6bc4da936f75cd2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:07Z,use_quota=True,user_id='af01dc984ac24fabbaf72e174f04a3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Creating volume 7e437374-623d-4fd2-b31e-6464d3d796d5 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:53:07 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:07 devstack sudo[83732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 1073741824 Apr 24 19:53:07 devstack sudo[83732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:07 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-39dd0016-d908-4d72-9e49-49159dcae8bd" returned: 0 in 0.803s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Lock "cinder-quobyte-39dd0016-d908-4d72-9e49-49159dcae8bd" released by "delete_volume" :: held 1.838s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Created reservations ['2762fb67-b9e6-43c2-b9ee-3cfc39dbab9d', '9fddaba7-ef92-4fc6-b85f-b9987ecb2160', 'a3cd7a3a-10b1-482f-83b6-a21f632d6a4f', '68664ab5-03d3-4398-97b2-bc25a474908e'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:07 devstack sudo[83734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:53:07 devstack sudo[83734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:08 devstack sudo[83734]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.831s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:08 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:53:08 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Deleted volume successfully. Apr 24 19:53:08 devstack sudo[83732]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 1073741824" returned: 0 in 1.138s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-95bea513-85c7-4c6c-84f6-d5d7bf111ef0 tempest-VolumesTestJSON-1323790132 None] Lock "cinder-39dd0016-d908-4d72-9e49-49159dcae8bd-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:08 devstack sudo[83748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 Apr 24 19:53:08 devstack sudo[83748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:09 devstack sudo[83748]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5" returned: 0 in 0.661s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:53:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c985aa6-5a44-4080-8d74-02e89b1d5917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e437374-623d-4fd2-b31e-6464d3d796d5', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8904e092-fc03-4cdf-86ca-a1e3629ff082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:09 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Volume volume-7e437374-623d-4fd2-b31e-6464d3d796d5 (7e437374-623d-4fd2-b31e-6464d3d796d5): created successfully Apr 24 19:53:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8904e092-fc03-4cdf-86ca-a1e3629ff082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Flow 'volume_create_manager' (5a758a19-fdd5-43f2-ac7e-436e616b8a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:53:09 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-4fc408ab-fcf2-43ac-9146-83653f46d13d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Created volume successfully. Apr 24 19:53:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-0c0fe8d2-88c7-450a-9e9c-d3560e8ef244 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-0c0fe8d2-88c7-450a-9e9c-d3560e8ef244 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:10 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[05092a33-30f0-47d9-b40c-d79c5fa22890]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-0c0fe8d2-88c7-450a-9e9c-d3560e8ef244 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:10 devstack sudo[83767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 Apr 24 19:53:10 devstack sudo[83767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:11 devstack sudo[83767]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-0c0fe8d2-88c7-450a-9e9c-d3560e8ef244 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5" returned: 0 in 0.783s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-0c0fe8d2-88c7-450a-9e9c-d3560e8ef244 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-0c0fe8d2-88c7-450a-9e9c-d3560e8ef244 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843', 'name': 'volume-7e437374-623d-4fd2-b31e-6464d3d796d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64cb312b-3d2f-4496-bf75-8e89d9868cdc', 'enforce_multipath': True} {{(pid=81641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:53:11 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-b299162c-ddd9-4514-96dd-645ca8bca158 req-0c0fe8d2-88c7-450a-9e9c-d3560e8ef244 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] attachment_update completed successfully. Apr 24 19:53:21 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:DELETE=5,cinder:SELECT=34,cinder:INSERT=7,cinder:UPDATE=30 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:53:21 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:INSERT=10,cinder:UPDATE=42,cinder:SELECT=20,cinder:DELETE=1 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Flow 'volume_create_manager' (0a53c37e-d841-4797-aefa-415641a74092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b98395-300f-44d5-9f28-3cd1dfdcf9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b98395-300f-44d5-9f28-3cd1dfdcf9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1380709547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5caecc12-7870-4083-94ee-8586c7bb1ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71477e42cae340c68ed413578e9fc7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:22Z,use_quota=True,user_id='fe3d8e5ac4c04697a1ef1c78943ddb5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998fe10e-4fbf-490a-b139-16633b7b4d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998fe10e-4fbf-490a-b139-16633b7b4d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e01996d-0278-4525-922a-3a4522c2efc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e01996d-0278-4525-922a-3a4522c2efc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5caecc12-7870-4083-94ee-8586c7bb1ea6', 'volume_name': 'volume-5caecc12-7870-4083-94ee-8586c7bb1ea6', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bcfe68-09cf-4106-91b8-e2a5e0adfcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7bcfe68-09cf-4106-91b8-e2a5e0adfcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4cd9af7-ebfd-4aa0-88d4-cbcf1b257ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:22 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Volume 5caecc12-7870-4083-94ee-8586c7bb1ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5caecc12-7870-4083-94ee-8586c7bb1ea6', 'volume_size': 1} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1380709547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5caecc12-7870-4083-94ee-8586c7bb1ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71477e42cae340c68ed413578e9fc7fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:22Z,use_quota=True,user_id='fe3d8e5ac4c04697a1ef1c78943ddb5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Creating volume 5caecc12-7870-4083-94ee-8586c7bb1ea6 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:53:22 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:53:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:22 devstack sudo[84245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 1073741824 Apr 24 19:53:22 devstack sudo[84245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:23 devstack sudo[84245]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 1073741824" returned: 0 in 0.941s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:23 devstack sudo[84261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 Apr 24 19:53:23 devstack sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:24 devstack sudo[84261]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6" returned: 0 in 0.522s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:53:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4cd9af7-ebfd-4aa0-88d4-cbcf1b257ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5caecc12-7870-4083-94ee-8586c7bb1ea6', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fc6a64-861a-4486-ac00-f956cb1093df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:24 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Volume volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 (5caecc12-7870-4083-94ee-8586c7bb1ea6): created successfully Apr 24 19:53:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fc6a64-861a-4486-ac00-f956cb1093df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Flow 'volume_create_manager' (0a53c37e-d841-4797-aefa-415641a74092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:53:24 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-d6d5fb0f-6dc2-482c-aba1-312714205b91 req-e9e13c0d-220d-4319-b30f-f506e2366966 tempest-VolumesSnapshotsTestJSON-2127536799 None] Created volume successfully. Apr 24 19:53:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Creating offline snapshot 9a6fe5f4-cfcc-4544-bf94-51706a7385a1 of volume 5caecc12-7870-4083-94ee-8586c7bb1ea6 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:53:25 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f624cc6-9d57-4c57-b142-4dd8e5229cb8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:25 devstack sudo[84305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 Apr 24 19:53:25 devstack sudo[84305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:26 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-efabfcdb-9631-41f3-8dc6-cdfe519bdbb1 tempest-GroupsV314Test-1303256442 None] Group tempest-GroupsV314Test-Group-624268503: creating Apr 24 19:53:26 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-efabfcdb-9631-41f3-8dc6-cdfe519bdbb1 tempest-GroupsV314Test-1303256442 None] Group tempest-GroupsV314Test-Group-624268503: created successfully Apr 24 19:53:26 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-efabfcdb-9631-41f3-8dc6-cdfe519bdbb1 tempest-GroupsV314Test-1303256442 None] Create group completed successfully. Apr 24 19:53:26 devstack sudo[84305]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6" returned: 0 in 0.734s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:26 devstack sudo[84320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 1G Apr 24 19:53:26 devstack sudo[84320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:27 devstack sudo[84320]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 1G" returned: 0 in 0.911s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:27 devstack sudo[84370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 Apr 24 19:53:27 devstack sudo[84370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Flow 'volume_create_manager' (da00f8ef-85e8-49f9-b139-77b95ccb1938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416d831d-ccda-40cd-8f17-d26894414714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:28 devstack sudo[84370]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1" returned: 0 in 1.253s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:28 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 is being set with open permissions: ugo+rw Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:28 devstack sudo[84417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416d831d-ccda-40cd-8f17-d26894414714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775270595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b565b2e3-4f28-4087-9852-24f81b21a338,host='devstack@QuobyteHD#QuobyteHD',id=6597d6a3-62e2-46b3-8258-1a9067b3b445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc6766fbc784658991b6a6b6f342e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:28Z,use_quota=True,user_id='519e28b1ea1b42448298afb94122f203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(692806c2-eed0-4a77-9def-88c5327583cb),volume_type_id=692806c2-eed0-4a77-9def-88c5327583cb)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:28 devstack sudo[84417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b593663f-2fea-4923-be5a-0e51653d49a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b593663f-2fea-4923-be5a-0e51653d49a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77113a2d-bb67-478f-a186-ad423eaf07a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77113a2d-bb67-478f-a186-ad423eaf07a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6597d6a3-62e2-46b3-8258-1a9067b3b445', 'volume_name': 'volume-6597d6a3-62e2-46b3-8258-1a9067b3b445', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecc3ae5-b32b-48e6-8bf1-45bdafbac0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecc3ae5-b32b-48e6-8bf1-45bdafbac0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c0077e-fb51-428a-a02b-855c38caa6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:28 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Volume 6597d6a3-62e2-46b3-8258-1a9067b3b445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6597d6a3-62e2-46b3-8258-1a9067b3b445', 'volume_size': 1} Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:28 devstack sudo[84417]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1" returned: 0 in 0.580s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:29 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.info Apr 24 19:53:29 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:29 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.info" returned: 0 in 0.714s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:29 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.info is being set with open permissions: ugo+rw Apr 24 19:53:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:29 devstack sudo[84463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.info Apr 24 19:53:29 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:30 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.info" returned: 0 in 0.849s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.248s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.217s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b565b2e3-4f28-4087-9852-24f81b21a338,created_at=2026-04-24T17:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775270595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b565b2e3-4f28-4087-9852-24f81b21a338,host='devstack@QuobyteHD#QuobyteHD',id=6597d6a3-62e2-46b3-8258-1a9067b3b445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc6766fbc784658991b6a6b6f342e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:28Z,use_quota=True,user_id='519e28b1ea1b42448298afb94122f203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(692806c2-eed0-4a77-9def-88c5327583cb),volume_type_id=692806c2-eed0-4a77-9def-88c5327583cb)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Creating volume 6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:53:30 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:53:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:30 devstack sudo[84466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 1073741824 Apr 24 19:53:30 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-c6cd568e-ae4e-40c8-8138-2e0b07c1ad0c req-be9b6c94-6d77-46e4-9a90-302bc4ef3cfe tempest-VolumesSnapshotsTestJSON-2127536799 None] Create snapshot completed successfully Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Acquiring lock "cinder-9a6fe5f4-cfcc-4544-bf94-51706a7385a1-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-9a6fe5f4-cfcc-4544-bf94-51706a7385a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Acquiring lock "cinder-quobyte-5caecc12-7870-4083-94ee-8586c7bb1ea6" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-quobyte-5caecc12-7870-4083-94ee-8586c7bb1ea6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Acquiring lock "cinder-quobyte-9a6fe5f4-cfcc-4544-bf94-51706a7385a1" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-quobyte-9a6fe5f4-cfcc-4544-bf94-51706a7385a1" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Deleting offline snapshot 9a6fe5f4-cfcc-4544-bf94-51706a7385a1 of volume 5caecc12-7870-4083-94ee-8586c7bb1ea6 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] snapshot_file for this snap is: volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[15098a93-8dbe-48df-a42b-490ab8a30541]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:31 devstack sudo[84488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 Apr 24 19:53:31 devstack sudo[84488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:32 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 1073741824" returned: 0 in 1.621s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:32 devstack sudo[84490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 Apr 24 19:53:32 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:32 devstack sudo[84488]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1" returned: 0 in 1.229s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5caecc12-7870-4083-94ee-8586c7bb1ea6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:53:32 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113b6cf-25b3-48ae-b408-78da5f071a3d]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:33 devstack sudo[84497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 Apr 24 19:53:33 devstack sudo[84497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:33 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445" returned: 0 in 0.929s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] <== create_volume: return (2643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:53:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.647s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c0077e-fb51-428a-a02b-855c38caa6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6597d6a3-62e2-46b3-8258-1a9067b3b445', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cebac60-4f94-4d06-a455-b85d88d26d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:33 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Volume volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 (6597d6a3-62e2-46b3-8258-1a9067b3b445): created successfully Apr 24 19:53:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cebac60-4f94-4d06-a455-b85d88d26d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Flow 'volume_create_manager' (da00f8ef-85e8-49f9-b139-77b95ccb1938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:53:33 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4462c900-2ae8-4522-816b-5b44bb114b92 tempest-GroupsV314Test-1303256442 None] Created volume successfully. Apr 24 19:53:33 devstack sudo[84497]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6" returned: 0 in 0.784s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:33 devstack sudo[84526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 Apr 24 19:53:33 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:34 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1" returned: 0 in 0.913s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:34 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1 Apr 24 19:53:34 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:35 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6.9a6fe5f4-cfcc-4544-bf94-51706a7385a1" returned: 0 in 0.732s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-quobyte-9a6fe5f4-cfcc-4544-bf94-51706a7385a1" released by "_delete_snapshot" :: held 3.848s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-quobyte-5caecc12-7870-4083-94ee-8586c7bb1ea6" released by "delete_snapshot" :: held 3.912s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:35 devstack cinder-volume[81641]: WARNING cinder.quota [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG cinder.quota [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Created reservations ['29b87fb6-5027-45e4-b524-0395342e138f', '2b3ab181-c025-4cd7-bc18-92ea943a23fa', '5acecd34-3690-4913-8106-0627300deabe', 'a1ff499d-0205-4c93-8477-c664f8cc6df5'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:53:35 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Delete snapshot completed successfully. Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:35 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Cloning volume 6597d6a3-62e2-46b3-8258-1a9067b3b445 to volume a0be2fb0-2788-44a4-a925-793f4a681981 Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-de003543-6b2f-4215-9796-3d9883699545 req-4e0bdcd2-a28b-4bbf-a821-cfeb43d03550 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-9a6fe5f4-cfcc-4544-bf94-51706a7385a1-delete_snapshot" released by "delete_snapshot" :: held 4.344s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Creating offline snapshot 24df6167-fdfe-4f65-81d1-960aeea4ef76 of volume 6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[be88ed91-8882-44b6-ac0d-385d32dadfe2]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:36 devstack sudo[84536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 Apr 24 19:53:36 devstack sudo[84536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Acquiring lock "cinder-5caecc12-7870-4083-94ee-8586c7bb1ea6-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-5caecc12-7870-4083-94ee-8586c7bb1ea6-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Acquiring lock "cinder-quobyte-5caecc12-7870-4083-94ee-8586c7bb1ea6" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-quobyte-5caecc12-7870-4083-94ee-8586c7bb1ea6" acquired by "delete_volume" :: waited 0.038s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:36 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6466d88d-a5ba-469f-b4e7-7aeb51e4ea73]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:36 devstack sudo[84542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 Apr 24 19:53:36 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:37 devstack sudo[84536]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445" returned: 0 in 1.357s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:37 devstack sudo[84564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 1G Apr 24 19:53:37 devstack sudo[84564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:37 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6" returned: 0 in 1.097s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:37 devstack sudo[84593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6 Apr 24 19:53:37 devstack sudo[84593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:38 devstack sudo[84564]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 1G" returned: 0 in 1.248s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:38 devstack sudo[84607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 Apr 24 19:53:38 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:39 devstack sudo[84593]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5caecc12-7870-4083-94ee-8586c7bb1ea6" returned: 0 in 1.249s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-quobyte-5caecc12-7870-4083-94ee-8586c7bb1ea6" released by "delete_volume" :: held 2.532s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG cinder.quota [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Created reservations ['000a17a4-1592-48e5-97b8-ac9c174414a0', '217320f1-4478-4b9c-ae38-2c52a75e21b6', '3d7e7543-0626-4574-8e2e-c3a949482734', '1296cdb1-bacf-41bd-bf0a-6324090b7801'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:39 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76" returned: 0 in 0.928s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:39 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:53:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:39 devstack sudo[84643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:53:39 devstack sudo[84643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:39 devstack sudo[84650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 Apr 24 19:53:39 devstack sudo[84650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:40 devstack sudo[84650]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76" returned: 0 in 1.068s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:40 devstack sudo[84663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.info Apr 24 19:53:40 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:40 devstack sudo[84643]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.341s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:40 devstack cinder-volume[81641]: DEBUG cinder.manager [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:53:40 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Deleted volume successfully. Apr 24 19:53:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c296b4f4-4947-4055-bd37-39f88bd148a6 req-fdb13a15-c50c-4579-901a-dd9251b84488 tempest-VolumesSnapshotsTestJSON-2127536799 None] Lock "cinder-5caecc12-7870-4083-94ee-8586c7bb1ea6-delete_volume" released by "delete_volume" :: held 4.407s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:41 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.info" returned: 0 in 1.251s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:41 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:53:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:41 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.info Apr 24 19:53:41 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:43 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.info" returned: 0 in 1.227s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Acquiring lock "cinder-quobyte-a0be2fb0-2788-44a4-a925-793f4a681981" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Lock "cinder-quobyte-a0be2fb0-2788-44a4-a925-793f4a681981" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] snapshot: 24df6167-fdfe-4f65-81d1-960aeea4ef76, volume: a0be2fb0-2788-44a4-a925-793f4a681981, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[381698b8-815d-4ce8-85e3-92eec265689a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:43 devstack sudo[84678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 Apr 24 19:53:43 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:44 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76" returned: 0 in 1.288s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6597d6a3-62e2-46b3-8258-1a9067b3b445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:53:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:53:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:53:44 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f6ec3f-ee3c-44a7-8dbf-628f72bd515c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:44 devstack sudo[84722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 Apr 24 19:53:44 devstack sudo[84722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:45 devstack sudo[84722]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445" returned: 0 in 0.930s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:45 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:53:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:45 devstack sudo[84756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 Apr 24 19:53:45 devstack sudo[84756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:50 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:UPDATE=21,cinder:SELECT=25,cinder:DELETE=2,cinder:INSERT=8 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:53:50 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Flow 'volume_create_manager' (40595eeb-e794-4b97-aa3a-76896746659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f649957a-fefa-47e3-b9b4-5eb0da62a0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f649957a-fefa-47e3-b9b4-5eb0da62a0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1111029430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837332d7-9850-4467-990f-a0c3d5ace412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806ab24c02a24bc5987a216595fba74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:52Z,use_quota=True,user_id='8fe5b1f2f2b54650b75a95f6ec803197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5792dda8-b519-44f3-9c0f-00d0cddc0d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5792dda8-b519-44f3-9c0f-00d0cddc0d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759bd943-c159-4e3f-aadf-e7950351448e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759bd943-c159-4e3f-aadf-e7950351448e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837332d7-9850-4467-990f-a0c3d5ace412', 'volume_name': 'volume-837332d7-9850-4467-990f-a0c3d5ace412', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd51958a-9a1a-4062-8c00-e5d00482bad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd51958a-9a1a-4062-8c00-e5d00482bad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:53:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04755aa8-4ef4-45f4-bd10-3ea15a308a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:53:52 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Volume 837332d7-9850-4467-990f-a0c3d5ace412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837332d7-9850-4467-990f-a0c3d5ace412', 'volume_size': 1} Apr 24 19:53:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:53:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:53:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:53:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:53:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:53:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:53:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:53 devstack sudo[84873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:53:53 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:55 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 2.065s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:55 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:53:56 devstack sudo[84756]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981" returned: 0 in 11.407s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:56 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f37ea65-1fc3-4847-a059-f48b1eb099a4]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:57 devstack sudo[84882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 Apr 24 19:53:57 devstack sudo[84882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:58 devstack sudo[84882]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445" returned: 0 in 1.114s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445, size 1024.00 MB, duration 11.41 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:53:58 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Converted 1024.00 MB image at 89.74 MB/s Apr 24 19:53:58 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:58 devstack sudo[84891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 Apr 24 19:53:58 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:58 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981" returned: 0 in 0.765s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Lock "cinder-quobyte-a0be2fb0-2788-44a4-a925-793f4a681981" released by "_copy_volume_from_snapshot" :: held 15.655s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Acquiring lock "cinder-quobyte-24df6167-fdfe-4f65-81d1-960aeea4ef76" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Lock "cinder-quobyte-24df6167-fdfe-4f65-81d1-960aeea4ef76" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Deleting offline snapshot 24df6167-fdfe-4f65-81d1-960aeea4ef76 of volume 6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] snapshot_file for this snap is: volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb94c136-f7a1-416d-afa0-ac9d32fa5e4e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:53:59 devstack sudo[84910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 Apr 24 19:53:59 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:53:59 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root Apr 24 19:53:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76" returned: 0 in 0.835s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:53:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6597d6a3-62e2-46b3-8258-1a9067b3b445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:53:59 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd53c4e4-641e-4d6c-8c8c-9b20dbb27a67]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:53:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:00 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2a1311a2-47b6-40d3-a2d1-59ba5da4f6de tempest-GroupsTest-1576560525 None] Group tempest-Group1-1744444916: creating Apr 24 19:54:00 devstack sudo[84924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 Apr 24 19:54:00 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:00 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2a1311a2-47b6-40d3-a2d1-59ba5da4f6de tempest-GroupsTest-1576560525 None] Group tempest-Group1-1744444916: created successfully Apr 24 19:54:00 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2a1311a2-47b6-40d3-a2d1-59ba5da4f6de tempest-GroupsTest-1576560525 None] Create group completed successfully. Apr 24 19:54:00 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445" returned: 0 in 0.633s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:00 devstack sudo[84929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 Apr 24 19:54:00 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:01 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76" returned: 0 in 0.631s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:01 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76 Apr 24 19:54:01 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-122a8bf6-af67-4a6a-9a0b-01ed77eabe16 tempest-GroupsTest-1576560525 None] Group tempest-Group2-2662608: creating Apr 24 19:54:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-122a8bf6-af67-4a6a-9a0b-01ed77eabe16 tempest-GroupsTest-1576560525 None] Group tempest-Group2-2662608: created successfully Apr 24 19:54:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-122a8bf6-af67-4a6a-9a0b-01ed77eabe16 tempest-GroupsTest-1576560525 None] Create group completed successfully. Apr 24 19:54:01 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445.24df6167-fdfe-4f65-81d1-960aeea4ef76" returned: 0 in 0.631s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Lock "cinder-quobyte-24df6167-fdfe-4f65-81d1-960aeea4ef76" released by "_delete_snapshot" :: held 2.874s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 26.013s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.797s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1111029430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837332d7-9850-4467-990f-a0c3d5ace412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806ab24c02a24bc5987a216595fba74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:53:52Z,use_quota=True,user_id='8fe5b1f2f2b54650b75a95f6ec803197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Creating volume 837332d7-9850-4467-990f-a0c3d5ace412 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:54:01 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:54:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:01 devstack sudo[84961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412 1073741824 Apr 24 19:54:01 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b76fb537-d391-4f5e-919b-4e3ce5794781 tempest-GroupsV314Test-1303256442 None] Create group from source-group-b565b2e3-4f28-4087-9852-24f81b21a338 completed successfully. Apr 24 19:54:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Acquiring lock "cinder-quobyte-a0be2fb0-2788-44a4-a925-793f4a681981" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Lock "cinder-quobyte-a0be2fb0-2788-44a4-a925-793f4a681981" acquired by "delete_volume" :: waited 0.014s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:02 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412 1073741824" returned: 0 in 1.056s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:02 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[99df8cf0-4614-482e-bbe2-2a6153cbaacd]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:02 devstack sudo[84968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412 Apr 24 19:54:02 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:03 devstack sudo[84967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 Apr 24 19:54:03 devstack sudo[84967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Flow 'volume_create_manager' (2485405b-7599-49bc-ab90-977553b0567d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfccd60-ca80-4a38-8868-7df44bffde2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfccd60-ca80-4a38-8868-7df44bffde2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1559235614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c57f6e7-124b-4472-9385-c57e6ad5019b,host='devstack@QuobyteHD#QuobyteHD',id=42aec1a4-118c-44b0-a46d-ffa2c882cb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03eed396eff4c2b84c432246dcd06b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:03Z,use_quota=True,user_id='1839687fcee64ab284d31e7d646d9cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8000c24-ada4-45dd-8ebc-d2c30c2db7ed),volume_type_id=b8000c24-ada4-45dd-8ebc-d2c30c2db7ed)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355f8944-a24f-452a-9abe-7ca887b856d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (355f8944-a24f-452a-9abe-7ca887b856d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cca6e88-61e2-4ec6-97af-608e5bb148e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cca6e88-61e2-4ec6-97af-608e5bb148e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42aec1a4-118c-44b0-a46d-ffa2c882cb29', 'volume_name': 'volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c831e8-9a6e-428b-a913-66c2f017ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c831e8-9a6e-428b-a913-66c2f017ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c23a16f-2cf5-4b66-a699-29e374856753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:03 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Volume 42aec1a4-118c-44b0-a46d-ffa2c882cb29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29', 'volume_size': 1} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:03 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412" returned: 0 in 0.643s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.041s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c57f6e7-124b-4472-9385-c57e6ad5019b,created_at=2026-04-24T17:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1559235614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c57f6e7-124b-4472-9385-c57e6ad5019b,host='devstack@QuobyteHD#QuobyteHD',id=42aec1a4-118c-44b0-a46d-ffa2c882cb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03eed396eff4c2b84c432246dcd06b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:03Z,use_quota=True,user_id='1839687fcee64ab284d31e7d646d9cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8000c24-ada4-45dd-8ebc-d2c30c2db7ed),volume_type_id=b8000c24-ada4-45dd-8ebc-d2c30c2db7ed)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Creating volume 42aec1a4-118c-44b0-a46d-ffa2c882cb29 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:54:03 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04755aa8-4ef4-45f4-bd10-3ea15a308a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837332d7-9850-4467-990f-a0c3d5ace412', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9ef775-4f0e-4a9d-bc4e-ae90c83839ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:03 devstack sudo[84977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 1073741824 Apr 24 19:54:03 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:03 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Volume volume-837332d7-9850-4467-990f-a0c3d5ace412 (837332d7-9850-4467-990f-a0c3d5ace412): created successfully Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9ef775-4f0e-4a9d-bc4e-ae90c83839ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Flow 'volume_create_manager' (40595eeb-e794-4b97-aa3a-76896746659f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:03 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-33627f18-e917-4963-af24-ed9bf5283cc6 tempest-ServerRescueNegativeTestJSON-317033842 None] Created volume successfully. Apr 24 19:54:03 devstack sudo[84967]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981" returned: 0 in 0.925s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:03 devstack sudo[84987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981 Apr 24 19:54:03 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:04 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a0be2fb0-2788-44a4-a925-793f4a681981" returned: 0 in 0.559s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:04 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Lock "cinder-quobyte-a0be2fb0-2788-44a4-a925-793f4a681981" released by "delete_volume" :: held 1.545s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 1073741824" returned: 0 in 0.796s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:04 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 Apr 24 19:54:04 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Created reservations ['52ef1032-244f-4529-a1bf-563ccb2c906f'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:04 devstack cinder-volume[81641]: WARNING cinder.quota [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1494981513 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1494981513, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:54:04 devstack cinder-volume[81641]: WARNING cinder.quota [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1494981513 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1494981513, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Created reservations ['d40a1a59-5eb3-4ef9-9737-591c2fe8868a', '112c461f-47c2-4579-82f4-c5b4d4b96ea0', '96abb3ed-3b1c-4a3c-924b-fe633bbfa92b', 'ecb63b5d-6ee1-4c3a-8b2b-e164b254d5b7'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:04 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:54:04 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:05 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29" returned: 0 in 0.621s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c23a16f-2cf5-4b66-a699-29e374856753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823bb363-2c87-4743-91bf-f00c82e1e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:05 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Volume volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 (42aec1a4-118c-44b0-a46d-ffa2c882cb29): created successfully Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823bb363-2c87-4743-91bf-f00c82e1e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Flow 'volume_create_manager' (2485405b-7599-49bc-ab90-977553b0567d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:05 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-edde408e-c411-49ce-93d7-15a49126a64b tempest-GroupsTest-1576560525 None] Created volume successfully. Apr 24 19:54:05 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.630s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:54:05 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6911ee8f-234d-4605-af33-92e2b63bc3b9 tempest-GroupsV314Test-1303256442 None] Delete group completed successfully. Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Acquiring lock "cinder-quobyte-6597d6a3-62e2-46b3-8258-1a9067b3b445" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Lock "cinder-quobyte-6597d6a3-62e2-46b3-8258-1a9067b3b445" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce8a27-0586-4398-adda-7f1697e9bbeb]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:05 devstack sudo[85013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 Apr 24 19:54:05 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:05 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445" returned: 0 in 0.561s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:05 devstack sudo[85018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445 Apr 24 19:54:05 devstack sudo[85018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Acquiring lock "cinder-quobyte-42aec1a4-118c-44b0-a46d-ffa2c882cb29" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Lock "cinder-quobyte-42aec1a4-118c-44b0-a46d-ffa2c882cb29" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a580e-0b32-4b18-8b8f-5478f8b32c9f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:06 devstack sudo[85020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 Apr 24 19:54:06 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:06 devstack sudo[85018]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6597d6a3-62e2-46b3-8258-1a9067b3b445" returned: 0 in 0.593s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Lock "cinder-quobyte-6597d6a3-62e2-46b3-8258-1a9067b3b445" released by "delete_volume" :: held 1.237s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Created reservations ['646b016f-5269-4aa4-a1bd-1d1dd33604ab'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Created reservations ['85182481-51ba-4889-971b-1324ab7bb385', 'be62c4b5-fb71-47d3-b36d-02e89a9b9187', '0d4dee10-1a94-49a5-8557-3ad32259a129', 'd8e805fb-bf27-4ba2-a67c-db11f6b0740d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:06 devstack sudo[85026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:54:06 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:06 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29" returned: 0 in 0.733s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:06 devstack sudo[85028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29 Apr 24 19:54:06 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:07 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.475s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:54:07 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-79348d97-7ec6-4d7d-a93e-fd2576b20496 tempest-GroupsV314Test-1303256442 None] Delete group completed successfully. Apr 24 19:54:07 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-42aec1a4-118c-44b0-a46d-ffa2c882cb29" returned: 0 in 0.483s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Lock "cinder-quobyte-42aec1a4-118c-44b0-a46d-ffa2c882cb29" released by "delete_volume" :: held 1.275s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Created reservations ['f8061cbf-bfd5-40a1-887d-eb7bc1a014d2'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:07 devstack cinder-volume[81641]: WARNING cinder.quota [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1530496912 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1530496912, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:54:07 devstack cinder-volume[81641]: WARNING cinder.quota [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1530496912 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1530496912, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Created reservations ['7ebba1e9-ffda-45f7-b17b-58ee45fccc45', '91cba5ad-06cc-472f-9e13-37f0759b1983', '2c863330-44d0-401b-a38e-77edc7289dc2', '91e0760c-bffe-4d94-89c4-575ae56865fc'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:07 devstack sudo[85035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:54:07 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:08 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.547s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:08 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:54:08 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4973b0ad-412b-47ea-b6b1-a986e767c2e9 tempest-GroupsTest-1576560525 None] Delete group completed successfully. Apr 24 19:54:08 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] Created reservations ['6ae5b01f-7b23-4054-8a82-abbcd1d046a5'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:08 devstack sudo[85039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:54:08 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:09 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.705s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:09 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:54:09 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6beb9768-b247-43d0-b62e-861c8f20b814 tempest-GroupsTest-1576560525 None] Delete group completed successfully. Apr 24 19:54:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-87c6b04a-8c1d-4dcd-a7b7-b302cb998f14 tempest-GroupsTest-1576560525 None] Group tempest-GroupsTest-Group-1961698936: creating Apr 24 19:54:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-87c6b04a-8c1d-4dcd-a7b7-b302cb998f14 tempest-GroupsTest-1576560525 None] Group tempest-GroupsTest-Group-1961698936: created successfully Apr 24 19:54:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-87c6b04a-8c1d-4dcd-a7b7-b302cb998f14 tempest-GroupsTest-1576560525 None] Create group completed successfully. Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Flow 'volume_create_manager' (b1ee6736-68f6-42c7-a3a8-8bfedbce85b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeba9ce2-9941-4bf6-a213-4af1c40b1121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeba9ce2-9941-4bf6-a213-4af1c40b1121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-189517249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0090214d-c1b5-4d06-8b94-095beec84e22,host='devstack@QuobyteHD#QuobyteHD',id=3e22ebdb-b886-4c15-9280-9fec94e25877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03eed396eff4c2b84c432246dcd06b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:12Z,use_quota=True,user_id='1839687fcee64ab284d31e7d646d9cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e90e69c0-c4a5-46ce-b801-8feea568d222),volume_type_id=e90e69c0-c4a5-46ce-b801-8feea568d222)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a3c568-728a-4556-8960-136797be3169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a3c568-728a-4556-8960-136797be3169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60bff038-7527-4fcf-af0a-0a492f0fda9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60bff038-7527-4fcf-af0a-0a492f0fda9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e22ebdb-b886-4c15-9280-9fec94e25877', 'volume_name': 'volume-3e22ebdb-b886-4c15-9280-9fec94e25877', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df9cac8-3b58-4b8b-84e6-146a69de9d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df9cac8-3b58-4b8b-84e6-146a69de9d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e0f321-763b-41e7-8cee-ffb9d5e778e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:12 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Volume 3e22ebdb-b886-4c15-9280-9fec94e25877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e22ebdb-b886-4c15-9280-9fec94e25877', 'volume_size': 1} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0090214d-c1b5-4d06-8b94-095beec84e22,created_at=2026-04-24T17:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-189517249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0090214d-c1b5-4d06-8b94-095beec84e22,host='devstack@QuobyteHD#QuobyteHD',id=3e22ebdb-b886-4c15-9280-9fec94e25877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03eed396eff4c2b84c432246dcd06b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:12Z,use_quota=True,user_id='1839687fcee64ab284d31e7d646d9cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e90e69c0-c4a5-46ce-b801-8feea568d222),volume_type_id=e90e69c0-c4a5-46ce-b801-8feea568d222)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Creating volume 3e22ebdb-b886-4c15-9280-9fec94e25877 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:54:12 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:54:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:12 devstack sudo[85139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877 1073741824 Apr 24 19:54:12 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:13 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877 1073741824" returned: 0 in 0.860s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:13 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877 Apr 24 19:54:13 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:13 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877" returned: 0 in 0.695s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:54:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e0f321-763b-41e7-8cee-ffb9d5e778e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e22ebdb-b886-4c15-9280-9fec94e25877', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c205fb1f-7a8f-4c35-be30-ebd741d15904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:14 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Volume volume-3e22ebdb-b886-4c15-9280-9fec94e25877 (3e22ebdb-b886-4c15-9280-9fec94e25877): created successfully Apr 24 19:54:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c205fb1f-7a8f-4c35-be30-ebd741d15904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Flow 'volume_create_manager' (b1ee6736-68f6-42c7-a3a8-8bfedbce85b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:14 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-ca592bd2-1f2e-4d19-9d84-a3317793ae39 tempest-GroupsTest-1576560525 None] Created volume successfully. Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Flow 'volume_create_manager' (980590b6-1c25-42d6-9e20-75bed8fdbcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e69cc4-7502-4014-9418-d7d2c9663cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e69cc4-7502-4014-9418-d7d2c9663cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306002119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0090214d-c1b5-4d06-8b94-095beec84e22,host='devstack@QuobyteHD#QuobyteHD',id=e8b7fd03-3292-4953-a8c1-ffcdc64a2312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03eed396eff4c2b84c432246dcd06b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:15Z,use_quota=True,user_id='1839687fcee64ab284d31e7d646d9cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e90e69c0-c4a5-46ce-b801-8feea568d222),volume_type_id=e90e69c0-c4a5-46ce-b801-8feea568d222)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a858ac0-a807-4754-9da2-88d3d7280d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a858ac0-a807-4754-9da2-88d3d7280d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5cbd46-9402-403c-8c11-f2533c5e604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5cbd46-9402-403c-8c11-f2533c5e604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b7fd03-3292-4953-a8c1-ffcdc64a2312', 'volume_name': 'volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974dd6a0-2b9a-4f7b-b6cd-01557b1d747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974dd6a0-2b9a-4f7b-b6cd-01557b1d747e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c455ea-af9c-4f47-aebc-5e31a23d7f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:15 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Volume e8b7fd03-3292-4953-a8c1-ffcdc64a2312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312', 'volume_size': 1} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0090214d-c1b5-4d06-8b94-095beec84e22,created_at=2026-04-24T17:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306002119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0090214d-c1b5-4d06-8b94-095beec84e22,host='devstack@QuobyteHD#QuobyteHD',id=e8b7fd03-3292-4953-a8c1-ffcdc64a2312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03eed396eff4c2b84c432246dcd06b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:15Z,use_quota=True,user_id='1839687fcee64ab284d31e7d646d9cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e90e69c0-c4a5-46ce-b801-8feea568d222),volume_type_id=e90e69c0-c4a5-46ce-b801-8feea568d222)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Creating volume e8b7fd03-3292-4953-a8c1-ffcdc64a2312 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:54:15 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:54:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:15 devstack sudo[85153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 1073741824 Apr 24 19:54:15 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:16 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 1073741824" returned: 0 in 0.981s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:16 devstack sudo[85170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 Apr 24 19:54:16 devstack sudo[85170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:17 devstack sudo[85170]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312" returned: 0 in 1.349s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:54:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c455ea-af9c-4f47-aebc-5e31a23d7f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357d59d4-35a9-4dff-81ab-d67e1b32cc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:17 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Volume volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 (e8b7fd03-3292-4953-a8c1-ffcdc64a2312): created successfully Apr 24 19:54:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357d59d4-35a9-4dff-81ab-d67e1b32cc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Flow 'volume_create_manager' (980590b6-1c25-42d6-9e20-75bed8fdbcec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:17 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e98966d9-a0d2-411b-9f64-cd235811030a tempest-GroupsTest-1576560525 None] Created volume successfully. Apr 24 19:54:19 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4e949945-e986-4152-a451-c5b3c06a4df2 tempest-GroupsTest-1576560525 None] Update group completed successfully. Apr 24 19:54:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-0aa900d3-ca4b-4e27-9872-5e86d9630fb4 tempest-GroupsTest-1576560525 None] Update group completed successfully. Apr 24 19:54:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Acquiring lock "cinder-quobyte-3e22ebdb-b886-4c15-9280-9fec94e25877" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Lock "cinder-quobyte-3e22ebdb-b886-4c15-9280-9fec94e25877" acquired by "delete_volume" :: waited 0.046s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:23 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[072d53d4-2049-4503-9eb2-96c0c7734e08]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:23 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877 Apr 24 19:54:23 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:24 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877" returned: 0 in 1.281s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:24 devstack sudo[85324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877 Apr 24 19:54:24 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:25 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e22ebdb-b886-4c15-9280-9fec94e25877" returned: 0 in 0.678s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Lock "cinder-quobyte-3e22ebdb-b886-4c15-9280-9fec94e25877" released by "delete_volume" :: held 2.087s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Acquiring lock "cinder-quobyte-e8b7fd03-3292-4953-a8c1-ffcdc64a2312" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Lock "cinder-quobyte-e8b7fd03-3292-4953-a8c1-ffcdc64a2312" acquired by "delete_volume" :: waited 0.034s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:25 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d8d8e-91a3-4e32-a0a9-d33e2bf3b477]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:25 devstack sudo[85347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 Apr 24 19:54:25 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:27 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312" returned: 0 in 1.571s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:27 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312 Apr 24 19:54:27 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:27 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e8b7fd03-3292-4953-a8c1-ffcdc64a2312" returned: 0 in 0.696s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Lock "cinder-quobyte-e8b7fd03-3292-4953-a8c1-ffcdc64a2312" released by "delete_volume" :: held 2.402s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:27 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Created reservations ['748f0182-e090-4b59-81b6-70f00948f83f'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:27 devstack cinder-volume[81641]: WARNING cinder.quota [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-910686407 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-910686407, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:54:27 devstack cinder-volume[81641]: WARNING cinder.quota [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-910686407 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-910686407, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:54:27 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Created reservations ['054d0d85-b6db-4127-ae68-5024d2092f8f', '3ef9b9f2-14e2-48ea-8c93-41da3fdc2ea0', '11d022b3-b840-495e-ac9f-fb97ba4c4950', '878d57f9-9680-4fc9-9aca-d2e97769ae39'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Created reservations ['636321fc-a31d-4722-9d5e-eecc5141fe60', '89f2a9dd-2806-447f-bc68-24158c969bbc', 'fc16dd62-3dc6-4e35-88c0-21b754401ade', 'd8381670-3ffc-4d73-a6ef-8dbad23d3fdc'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Acquiring lock "cinder-837332d7-9850-4467-990f-a0c3d5ace412-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:28 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:54:28 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "cinder-837332d7-9850-4467-990f-a0c3d5ace412-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Acquiring lock "cinder-quobyte-837332d7-9850-4467-990f-a0c3d5ace412" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "cinder-quobyte-837332d7-9850-4467-990f-a0c3d5ace412" acquired by "delete_volume" :: waited 0.049s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[065eaa52-71c5-4fac-8db7-b6759aabb1f5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Flow 'volume_create_manager' (54334266-50a7-4e7c-9714-8a47c74636ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd251411-02db-455d-869f-9d7d6f868399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd251411-02db-455d-869f-9d7d6f868399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1876803577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ef23a29d4145adad843ad31392b59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:29Z,use_quota=True,user_id='bc406944a8654fdb9b3af505b9054e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:28 devstack sudo[85411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412 Apr 24 19:54:28 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c04991a-e487-47fb-9a83-897e631cdc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c04991a-e487-47fb-9a83-897e631cdc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aadcb28-d8dc-4abf-8843-35efbb091f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aadcb28-d8dc-4abf-8843-35efbb091f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d', 'volume_name': 'volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcaf96d-a5dd-4858-9489-2c936232bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcaf96d-a5dd-4858-9489-2c936232bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5beef8-650f-409d-9775-40b16a63ceae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:29 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Volume a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d', 'volume_size': 1} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1876803577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ef23a29d4145adad843ad31392b59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:29Z,use_quota=True,user_id='bc406944a8654fdb9b3af505b9054e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Creating volume a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:54:29 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:29 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d 1073741824 Apr 24 19:54:29 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:29 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.268s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:29 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:54:29 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-987c000d-98bc-427e-8199-e7bec056284c tempest-GroupsTest-1576560525 None] Delete group completed successfully. Apr 24 19:54:30 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412" returned: 0 in 1.290s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:30 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412 Apr 24 19:54:30 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:30 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d 1073741824" returned: 0 in 1.499s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:30 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d Apr 24 19:54:30 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:30 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-837332d7-9850-4467-990f-a0c3d5ace412" returned: 0 in 0.700s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "cinder-quobyte-837332d7-9850-4467-990f-a0c3d5ace412" released by "delete_volume" :: held 2.080s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:30 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Created reservations ['51810086-3303-4adf-b107-875a978851fd', '5f832c65-c98d-42ca-9e24-3fce94c1abbb', 'dc948c57-8c6f-4b10-acef-6c7d25528c3d', 'f6d1092c-b7c6-4c59-bacf-6ad4c10569a1'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:31 devstack sudo[85432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:54:31 devstack sudo[85432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:31 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d" returned: 0 in 0.731s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5beef8-650f-409d-9775-40b16a63ceae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b102fc87-65a4-44b7-a6cd-e509de5af7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:31 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Volume volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d (a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d): created successfully Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b102fc87-65a4-44b7-a6cd-e509de5af7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Flow 'volume_create_manager' (54334266-50a7-4e7c-9714-8a47c74636ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:31 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4cb6ef32-6e0b-4999-91af-0ec416fad08a tempest-VolumeQuotasNegativeTestJSON-727372948 None] Created volume successfully. Apr 24 19:54:31 devstack sudo[85432]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.690s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:54:31 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Deleted volume successfully. Apr 24 19:54:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-556def03-8695-44fb-a483-9e0153117e96 tempest-ServerRescueNegativeTestJSON-317033842 None] Lock "cinder-837332d7-9850-4467-990f-a0c3d5ace412-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Acquiring lock "cinder-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "cinder-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Acquiring lock "cinder-quobyte-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "cinder-quobyte-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:33 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1887da4-e40c-47dc-a06a-89bf5d408c50]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:34 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d Apr 24 19:54:34 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:34 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d" returned: 0 in 1.164s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:34 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d Apr 24 19:54:34 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:35 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d" returned: 0 in 0.707s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "cinder-quobyte-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d" released by "delete_volume" :: held 1.939s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:35 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Created reservations ['dfd12dfb-e7d2-4aae-bc37-d72d940deef2', 'e37f4eed-c63b-4426-b3d9-9d63a5480039', 'eec33c05-1311-4e0d-a431-10b9b750d097', '3d832f56-e51f-4ddd-8526-5c3d9d5c76ab'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:36 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:54:36 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:37 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.673s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:37 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:54:37 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Deleted volume successfully. Apr 24 19:54:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-10181e5e-58a0-4daa-b81d-8215cc738999 tempest-VolumeQuotasNegativeTestJSON-727372948 None] Lock "cinder-a5f57bbb-2738-4cd6-90a7-bb7c1ac5910d-delete_volume" released by "delete_volume" :: held 4.092s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:38 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:54:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Flow 'volume_create_manager' (57441455-8e4f-4e92-9115-cea5a36a221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8485ad47-19b7-4eee-8ac8-42417542e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8485ad47-19b7-4eee-8ac8-42417542e306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48cc3ae-d75a-4eb5-96dd-22d524f8ec27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a241b083e843a6bc4da936f75cd2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:39Z,use_quota=True,user_id='af01dc984ac24fabbaf72e174f04a3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc5c3d6-6ba3-4dee-9186-8a792b5d9ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc5c3d6-6ba3-4dee-9186-8a792b5d9ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a45bb3-00b6-4c3d-9329-f1678760b50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:38 devstack cinder-volume[81641]: DEBUG cinder.image.glance [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Creating Keystone auth plugin from conf {{(pid=81641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:54:39 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a45bb3-00b6-4c3d-9329-f1678760b50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e48cc3ae-d75a-4eb5-96dd-22d524f8ec27', 'volume_name': 'volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:39 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f3b3df-e2f9-45de-9b1e-1a6dab1f918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:39 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f3b3df-e2f9-45de-9b1e-1a6dab1f918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:39 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d4f64a-2053-4f9e-9ee2-c49f2e6b7a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:39 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Volume e48cc3ae-d75a-4eb5-96dd-22d524f8ec27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:54:39 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Trying to clone e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 from image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]). {{(pid=81641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:54:40 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:54:40 devstack cinder-volume[81641]: INFO cinder.image.image_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:54:40 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba91f61e-0a9c-49f9-83fd-7a55176ddd81]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:40 devstack sudo[85514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD Apr 24 19:54:40 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:40 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:40 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Temporary image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 is fetched for user af01dc984ac24fabbaf72e174f04a3f0. {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:54:40 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[837ecbda-ad42-4fca-983b-8f67cad5fce5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:41 devstack sudo[85520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD Apr 24 19:54:41 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:41 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD" returned: 0 in 0.638s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48cc3ae-d75a-4eb5-96dd-22d524f8ec27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a241b083e843a6bc4da936f75cd2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:39Z,use_quota=True,user_id='af01dc984ac24fabbaf72e174f04a3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Creating volume e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:54:41 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:54:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:41 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 1073741824 Apr 24 19:54:41 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:42 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 1073741824" returned: 0 in 0.998s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:42 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 Apr 24 19:54:42 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:43 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" returned: 0 in 0.565s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:54:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:43 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Attempting download of 2f4436ec-2be7-46ed-af6e-ed3ceb305141 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}])) to volume e48cc3ae-d75a-4eb5-96dd-22d524f8ec27. {{(pid=81641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:54:43 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8097072-0c6b-47d6-b074-3435c98b13e3]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_li7uiycf {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:43 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_li7uiycf Apr 24 19:54:43 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:44 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_li7uiycf" returned: 0 in 0.801s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_li7uiycf {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:44 devstack sudo[85538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_li7uiycf Apr 24 19:54:44 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:45 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_li7uiycf" returned: 1 in 0.999s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_li7uiycf' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb2a12-aa7b-48c6-9931-6161b5955baf]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:45 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD Apr 24 19:54:45 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Flow 'volume_create_manager' (a268b995-97e9-4292-99ea-2d914795016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987d071e-7a37-44f2-b519-bff13a00326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987d071e-7a37-44f2-b519-bff13a00326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-562082821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf94425-7fc8-4a06-bf5f-ab159a6013d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61bb2afe8f24d008f662ad1ccaa8984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:45Z,use_quota=True,user_id='d4fce82a97f34a4985f097b7ba4108cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14205317-563c-42c5-bdaf-990eab57c96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14205317-563c-42c5-bdaf-990eab57c96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c243c05e-ec2f-44ae-88c0-b3821f08aae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c243c05e-ec2f-44ae-88c0-b3821f08aae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf94425-7fc8-4a06-bf5f-ab159a6013d2', 'volume_name': 'volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13d7334-5d10-4d94-ae4a-17912aa232b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13d7334-5d10-4d94-ae4a-17912aa232b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fead4625-9772-4b12-b572-2b9d9e4529c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Volume 3cf94425-7fc8-4a06-bf5f-ab159a6013d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2', 'volume_size': 1} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-562082821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf94425-7fc8-4a06-bf5f-ab159a6013d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61bb2afe8f24d008f662ad1ccaa8984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:45Z,use_quota=True,user_id='d4fce82a97f34a4985f097b7ba4108cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Creating volume 3cf94425-7fc8-4a06-bf5f-ab159a6013d2 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:54:45 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:45 devstack sudo[85573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 1073741824 Apr 24 19:54:45 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:45 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] 2f4436ec-2be7-46ed-af6e-ed3ceb305141 was qcow2, converting to raw {{(pid=81641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:54:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:45 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 Apr 24 19:54:45 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:46 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 1073741824" returned: 0 in 0.921s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:46 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 Apr 24 19:54:46 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:47 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2" returned: 0 in 0.880s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fead4625-9772-4b12-b572-2b9d9e4529c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a9e2ec-ae52-4f08-a300-ed7011066473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:47 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Volume volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 (3cf94425-7fc8-4a06-bf5f-ab159a6013d2): created successfully Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a9e2ec-ae52-4f08-a300-ed7011066473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Flow 'volume_create_manager' (a268b995-97e9-4292-99ea-2d914795016c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:47 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-713e533e-ea24-4c52-9131-33a7dcc35517 tempest-VolumesServicesTestJSON-1556075241 None] Created volume successfully. Apr 24 19:54:47 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" returned: 0 in 1.912s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_xarjpbwwdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:54:47 devstack cinder-volume[81641]: INFO cinder.image.image_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Converted 112.00 MB image at 58.56 MB/s Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:47 devstack sudo[85597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 1G Apr 24 19:54:47 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Flow 'volume_create_manager' (1fef359f-2667-49e7-86a0-63ebbd7553df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f19ca3-2e1a-493f-9369-0d0bce537343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f19ca3-2e1a-493f-9369-0d0bce537343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1242384367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af8a362-982c-490c-b87c-c8950cf43b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342ea62fe2e41fe9729ddcfa7896f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:48Z,use_quota=True,user_id='dd969b2227c049c5b90118bb115bfdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8ae654-946f-4ac3-9ad1-264e4556e13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8ae654-946f-4ac3-9ad1-264e4556e13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6305de49-2da4-483d-9cf9-39c02e0aba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6305de49-2da4-483d-9cf9-39c02e0aba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af8a362-982c-490c-b87c-c8950cf43b29', 'volume_name': 'volume-9af8a362-982c-490c-b87c-c8950cf43b29', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c373f5e4-11cb-4b9e-ab21-2e84b1317bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c373f5e4-11cb-4b9e-ab21-2e84b1317bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242a2344-4ede-4060-9c1b-f80f53d8b3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:48 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Volume 9af8a362-982c-490c-b87c-c8950cf43b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af8a362-982c-490c-b87c-c8950cf43b29', 'volume_size': 1} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1242384367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af8a362-982c-490c-b87c-c8950cf43b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342ea62fe2e41fe9729ddcfa7896f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:48Z,use_quota=True,user_id='dd969b2227c049c5b90118bb115bfdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Creating volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:54:48 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:48 devstack sudo[85600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 1073741824 Apr 24 19:54:48 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:48 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 1G" returned: 0 in 0.561s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccdf8dc-af4d-4c5b-b639-80bc1ef46f69]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:48 devstack sudo[85605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 Apr 24 19:54:48 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Acquiring lock "cinder-3cf94425-7fc8-4a06-bf5f-ab159a6013d2-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Lock "cinder-3cf94425-7fc8-4a06-bf5f-ab159a6013d2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Acquiring lock "cinder-quobyte-3cf94425-7fc8-4a06-bf5f-ab159a6013d2" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Lock "cinder-quobyte-3cf94425-7fc8-4a06-bf5f-ab159a6013d2" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfcf8ed-27ae-4cb1-b435-7e656c0544ea]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:48 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 1073741824" returned: 0 in 0.870s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:48 devstack sudo[85610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 Apr 24 19:54:48 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:48 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 Apr 24 19:54:48 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:49 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" returned: 0 in 0.684s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:49 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 Apr 24 19:54:49 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:49 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2" returned: 0 in 0.567s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:49 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29" returned: 0 in 0.488s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:49 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2 Apr 24 19:54:49 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242a2344-4ede-4060-9c1b-f80f53d8b3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af8a362-982c-490c-b87c-c8950cf43b29', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2446ee-e41c-4efd-95ef-b853664c863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:49 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Volume volume-9af8a362-982c-490c-b87c-c8950cf43b29 (9af8a362-982c-490c-b87c-c8950cf43b29): created successfully Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2446ee-e41c-4efd-95ef-b853664c863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Flow 'volume_create_manager' (1fef359f-2667-49e7-86a0-63ebbd7553df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:49 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-233545ca-31f1-451a-8a65-a64ae16762b7 tempest-SnapshotsActionsTest-781993171 None] Created volume successfully. Apr 24 19:54:49 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" returned: 1 in 0.595s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Downloaded image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}])) to volume e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 successfully. {{(pid=81641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Temporary image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 for user af01dc984ac24fabbaf72e174f04a3f0 is deleted. {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Marking volume e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 as bootable. {{(pid=81641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Copying metadata from image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 to e48cc3ae-d75a-4eb5-96dd-22d524f8ec27. {{(pid=81641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Creating volume glance metadata for volume e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 backed by image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d4f64a-2053-4f9e-9ee2-c49f2e6b7a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52aadd8-421c-46e1-a311-5aea6915d23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:49 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Volume volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 (e48cc3ae-d75a-4eb5-96dd-22d524f8ec27): created successfully Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52aadd8-421c-46e1-a311-5aea6915d23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Flow 'volume_create_manager' (57441455-8e4f-4e92-9115-cea5a36a221d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:49 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-2a845abc-974b-41ae-ac55-e1c921c03cfc tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Created volume successfully. Apr 24 19:54:49 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3cf94425-7fc8-4a06-bf5f-ab159a6013d2" returned: 0 in 0.584s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Lock "cinder-quobyte-3cf94425-7fc8-4a06-bf5f-ab159a6013d2" released by "delete_volume" :: held 1.195s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Created reservations ['92236709-74b0-4202-8d02-fe05f115121d', '5777ab89-9137-4043-9f01-14272cc59d66', '7915d4f5-b2b0-4e0c-952d-dd22fcdf8240', 'b10bb48f-7923-4bdd-b99b-5a5c0f33963b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:50 devstack sudo[85628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:54:50 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Creating offline snapshot 3c58d361-baff-46a3-8c82-0506bf37b389 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c5065-47ea-42aa-a082-444094e4baba]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:50 devstack sudo[85630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 Apr 24 19:54:50 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:50 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.477s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:54:50 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Deleted volume successfully. Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=95,cinder:UPDATE=114,cinder:INSERT=26,cinder:DELETE=8 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ac48ee3b-3fe8-4a27-b3f2-abdf7332947f tempest-VolumesServicesTestJSON-1556075241 None] Lock "cinder-3cf94425-7fc8-4a06-bf5f-ab159a6013d2-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:54:50 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29" returned: 0 in 0.659s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:50 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 1G Apr 24 19:54:50 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:51 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=100,cinder:UPDATE=109,cinder:INSERT=32,cinder:DELETE=3 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:54:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:51 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 1G" returned: 0 in 0.791s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:51 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:54:51 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:52 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.620s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:52 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 is being set with open permissions: ugo+rw Apr 24 19:54:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:52 devstack sudo[85654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:54:52 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:53 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.626s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:53 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.info Apr 24 19:54:53 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:53 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:54:53 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:53 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.594s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:54:53 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.info" returned: 0 in 0.639s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:53 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.info is being set with open permissions: ugo+rw Apr 24 19:54:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:53 devstack sudo[85664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.info Apr 24 19:54:53 devstack sudo[85664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:54 devstack sudo[85664]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.info" returned: 0 in 0.657s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.099s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.788s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:54 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea8f0df-ed5f-4660-9358-aa5b0f1f214a]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:54 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4afb5a13-e75d-4479-abde-647b437e2158 tempest-SnapshotsActionsTest-781993171 None] Create snapshot completed successfully Apr 24 19:54:54 devstack sudo[85669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 Apr 24 19:54:54 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:55 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" returned: 0 in 0.625s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:55 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 Apr 24 19:54:55 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:55 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" returned: 1 in 0.828s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:54:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.497s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843', 'name': 'volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'affc794d-a4fa-4444-87be-f413323c25f9', 'enforce_multipath': True} {{(pid=81641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:54:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-709034d3-aa8f-4465-84c2-c9d07b5ada2e req-172d86db-1d7b-4796-a32f-c996e19e97aa tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] attachment_update completed successfully. Apr 24 19:54:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Creating offline snapshot 726b8e27-0d37-4414-b5f1-ffded7c4f2b2 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:54:56 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5832507-4ff5-4165-953e-c92438f9779e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:54:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:56 devstack sudo[85696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:54:56 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:57 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.834s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:54:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:57 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 1G Apr 24 19:54:57 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:58 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 1G" returned: 0 in 0.787s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:58 devstack sudo[85707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 Apr 24 19:54:58 devstack sudo[85707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:58 devstack sudo[85707]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2" returned: 0 in 0.645s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:58 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 is being set with open permissions: ugo+rw Apr 24 19:54:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:58 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 Apr 24 19:54:58 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Flow 'volume_create_manager' (aeb554ad-12d5-4da7-ba44-929f2c4d3658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a7a458-cedc-4c56-ba88-4924ad7f59c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a7a458-cedc-4c56-ba88-4924ad7f59c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2095823138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbc71a3-3d25-4875-935d-6273a13cda1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a12a0b02f18a4425a068db195eb4f959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:59Z,use_quota=True,user_id='7f4cdb20a853464fa4565fcb743006aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acfdcd4-b441-4b7e-8c2e-15819c7ac0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acfdcd4-b441-4b7e-8c2e-15819c7ac0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bea3539-6985-4176-9f15-f26442110dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bea3539-6985-4176-9f15-f26442110dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cbc71a3-3d25-4875-935d-6273a13cda1a', 'volume_name': 'volume-1cbc71a3-3d25-4875-935d-6273a13cda1a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd522b15-4187-4972-b479-31bc2c67a714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd522b15-4187-4972-b479-31bc2c67a714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebae5e41-d7dc-41db-864e-b582f37159fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:54:59 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Volume 1cbc71a3-3d25-4875-935d-6273a13cda1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cbc71a3-3d25-4875-935d-6273a13cda1a', 'volume_size': 1} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:59 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2" returned: 0 in 0.608s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.253s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2095823138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbc71a3-3d25-4875-935d-6273a13cda1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a12a0b02f18a4425a068db195eb4f959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:54:59Z,use_quota=True,user_id='7f4cdb20a853464fa4565fcb743006aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Creating volume 1cbc71a3-3d25-4875-935d-6273a13cda1a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:54:59 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:54:59 devstack sudo[85718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a 1073741824 Apr 24 19:54:59 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:54:59 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-953b535a-8d0c-4db5-bb40-aac3123aae36 tempest-SnapshotsActionsTest-781993171 None] Create snapshot completed successfully Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-726b8e27-0d37-4414-b5f1-ffded7c4f2b2-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-726b8e27-0d37-4414-b5f1-ffded7c4f2b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:54:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-quobyte-726b8e27-0d37-4414-b5f1-ffded7c4f2b2" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-726b8e27-0d37-4414-b5f1-ffded7c4f2b2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Deleting offline snapshot 726b8e27-0d37-4414-b5f1-ffded7c4f2b2 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] snapshot_file for this snap is: volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faff2e5-9c04-4f55-90bb-13a8fe712e06]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:00 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 Apr 24 19:55:00 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:00 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a 1073741824" returned: 0 in 0.795s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:00 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a Apr 24 19:55:00 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:00 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2" returned: 0 in 0.730s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f794ba-7444-4837-bc04-cb7f0d029f72]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:00 devstack sudo[85735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:00 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:00 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a" returned: 0 in 0.527s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebae5e41-d7dc-41db-864e-b582f37159fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbc71a3-3d25-4875-935d-6273a13cda1a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8da212e-44db-4240-beb2-3e1bf5a4e36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:01 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Volume volume-1cbc71a3-3d25-4875-935d-6273a13cda1a (1cbc71a3-3d25-4875-935d-6273a13cda1a): created successfully Apr 24 19:55:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8da212e-44db-4240-beb2-3e1bf5a4e36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Flow 'volume_create_manager' (aeb554ad-12d5-4da7-ba44-929f2c4d3658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-a153288b-cd7c-4aa7-a318-4e23b009ab84 req-d1fa2adf-52e6-4631-94f9-9ef64f40503b tempest-VolumesGetTestJSON-405017006 None] Created volume successfully. Apr 24 19:55:01 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.747s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:01 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 Apr 24 19:55:01 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Acquiring lock "cinder-1cbc71a3-3d25-4875-935d-6273a13cda1a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Lock "cinder-1cbc71a3-3d25-4875-935d-6273a13cda1a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Acquiring lock "cinder-quobyte-1cbc71a3-3d25-4875-935d-6273a13cda1a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Lock "cinder-quobyte-1cbc71a3-3d25-4875-935d-6273a13cda1a" acquired by "delete_volume" :: waited 0.028s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:02 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dcbfb4-679a-4e8f-bf53-1a9a105e28e0]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:02 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a Apr 24 19:55:02 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:02 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2" returned: 0 in 1.187s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:02 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2 Apr 24 19:55:02 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:03 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a" returned: 0 in 1.084s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:03 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.726b8e27-0d37-4414-b5f1-ffded7c4f2b2" returned: 0 in 0.699s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:03 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a Apr 24 19:55:03 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-726b8e27-0d37-4414-b5f1-ffded7c4f2b2" released by "_delete_snapshot" :: held 3.585s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" released by "delete_snapshot" :: held 3.622s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Flow 'volume_create_manager' (bcc42ed3-6188-493e-a9d8-1ee3a1f80c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e84efea-426f-4281-b18d-c747266c6b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e84efea-426f-4281-b18d-c747266c6b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-129634834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6002a4-f846-462e-bffc-ec728a5e0974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039696c035e34bfabdb7b63031e8285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:04Z,use_quota=True,user_id='c299042d62084a25807b069dad162dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f784f393-b7bf-411b-8d48-9608e4cf5de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f784f393-b7bf-411b-8d48-9608e4cf5de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94634bd6-b6ce-43af-8fe4-0515936768b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94634bd6-b6ce-43af-8fe4-0515936768b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6002a4-f846-462e-bffc-ec728a5e0974', 'volume_name': 'volume-5c6002a4-f846-462e-bffc-ec728a5e0974', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436eac8e-2920-4f0d-bdcb-64ec1ac83d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436eac8e-2920-4f0d-bdcb-64ec1ac83d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63f6932-1ff4-459f-8592-647a70dc442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:03 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Volume 5c6002a4-f846-462e-bffc-ec728a5e0974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6002a4-f846-462e-bffc-ec728a5e0974', 'volume_size': 1} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-129634834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6002a4-f846-462e-bffc-ec728a5e0974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039696c035e34bfabdb7b63031e8285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:04Z,use_quota=True,user_id='c299042d62084a25807b069dad162dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Creating volume 5c6002a4-f846-462e-bffc-ec728a5e0974 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:03 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:03 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974 1073741824 Apr 24 19:55:03 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:03 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Created reservations ['0b8e7023-a1af-439c-b4fa-ea3037cad89e', '3bb47b65-994f-40e3-a124-6a1bd7fe27b6', '5f416c38-eaf9-43f1-9025-adbd6c2d12b0', '0e9a47a3-0ef8-4f46-b1b2-67fd92cb2d24'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:03 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Delete snapshot completed successfully. Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23125103-322a-4320-a064-ed8dfc59943b tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-726b8e27-0d37-4414-b5f1-ffded7c4f2b2-delete_snapshot" released by "delete_snapshot" :: held 4.019s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:04 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1cbc71a3-3d25-4875-935d-6273a13cda1a" returned: 0 in 0.654s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Lock "cinder-quobyte-1cbc71a3-3d25-4875-935d-6273a13cda1a" released by "delete_volume" :: held 1.826s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG cinder.quota [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Created reservations ['d1ed784c-3fa1-4e51-8279-542b9d217d1e', '869ba37c-df60-42ac-aae9-8f77919af9e3', '15af6b90-a0a8-4f33-ab62-0f0ac02b94b0', 'b007d60c-558f-43f1-b6d7-fdcb03b797b5'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:04 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:04 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:05 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974 1073741824" returned: 0 in 1.296s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:05 devstack sudo[85949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974 Apr 24 19:55:05 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:05 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.923s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG cinder.manager [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:05 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Deleted volume successfully. Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-6a96df71-29fa-48fe-9945-5bfd8238cc61 req-ca7217eb-638b-45de-a001-c41ed0329f2c tempest-VolumesGetTestJSON-405017006 None] Lock "cinder-1cbc71a3-3d25-4875-935d-6273a13cda1a-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:05 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974" returned: 0 in 0.766s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.830s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Creating offline snapshot 157aae4d-37ad-4335-ad9e-a63f14b9c864 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63f6932-1ff4-459f-8592-647a70dc442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6002a4-f846-462e-bffc-ec728a5e0974', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf070a21-42dc-46a1-bdd4-63862f10d120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0bf91a-33e0-4318-b80e-0c09ac43f709]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:06 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Volume volume-5c6002a4-f846-462e-bffc-ec728a5e0974 (5c6002a4-f846-462e-bffc-ec728a5e0974): created successfully Apr 24 19:55:06 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf070a21-42dc-46a1-bdd4-63862f10d120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:06 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Flow 'volume_create_manager' (bcc42ed3-6188-493e-a9d8-1ee3a1f80c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:06 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b1aa4cf6-8e57-4a04-a784-1e22e4aa320f tempest-VolumesListAdminTestJSON-1614345256 None] Created volume successfully. Apr 24 19:55:06 devstack sudo[85958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:06 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:06 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.853s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:06 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 1G Apr 24 19:55:06 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Flow 'volume_create_manager' (76c34807-5263-45a8-9bff-394b5157560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f1fca6-8c5b-4360-8fc3-5e7043213828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f1fca6-8c5b-4360-8fc3-5e7043213828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-662961471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7c318d-22aa-4e83-ad40-1dfc393b8a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039696c035e34bfabdb7b63031e8285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:08Z,use_quota=True,user_id='c299042d62084a25807b069dad162dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c261aa84-ee0b-40a5-9061-5b1a1db495cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c261aa84-ee0b-40a5-9061-5b1a1db495cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d190c8-9e3c-4063-8e96-d240404a258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d190c8-9e3c-4063-8e96-d240404a258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7c318d-22aa-4e83-ad40-1dfc393b8a2e', 'volume_name': 'volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e341704-ca57-4b7d-a277-85392b07ed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e341704-ca57-4b7d-a277-85392b07ed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f821fe-0b20-4074-82f3-ee5e28b24e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:07 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Volume 7c7c318d-22aa-4e83-ad40-1dfc393b8a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e', 'volume_size': 1} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:07 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 1G" returned: 0 in 1.118s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:08 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 Apr 24 19:55:08 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:08 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864" returned: 0 in 0.741s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:08 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 is being set with open permissions: ugo+rw Apr 24 19:55:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:08 devstack sudo[85977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 Apr 24 19:55:08 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:09 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864" returned: 0 in 0.481s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.335s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-662961471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7c318d-22aa-4e83-ad40-1dfc393b8a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039696c035e34bfabdb7b63031e8285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:08Z,use_quota=True,user_id='c299042d62084a25807b069dad162dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Creating volume 7c7c318d-22aa-4e83-ad40-1dfc393b8a2e {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:09 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:09 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-669d0254-d9fa-4e23-a921-0095283dfb91 tempest-SnapshotsActionsTest-781993171 None] Create snapshot completed successfully Apr 24 19:55:09 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e 1073741824 Apr 24 19:55:09 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:09 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e 1073741824" returned: 0 in 0.677s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:09 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e Apr 24 19:55:09 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-68438c45-fc8e-458e-acaf-1859a2202699 tempest-GroupSnapshotsTest-941597013 None] Group tempest-GroupSnapshotsTest-Group-1569350130: creating Apr 24 19:55:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-68438c45-fc8e-458e-acaf-1859a2202699 tempest-GroupSnapshotsTest-941597013 None] Group tempest-GroupSnapshotsTest-Group-1569350130: created successfully Apr 24 19:55:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-68438c45-fc8e-458e-acaf-1859a2202699 tempest-GroupSnapshotsTest-941597013 None] Create group completed successfully. Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-157aae4d-37ad-4335-ad9e-a63f14b9c864-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:10 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-157aae4d-37ad-4335-ad9e-a63f14b9c864-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e" returned: 0 in 0.561s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f821fe-0b20-4074-82f3-ee5e28b24e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e329aff-b862-4977-aaf6-bbd2bb58177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-quobyte-157aae4d-37ad-4335-ad9e-a63f14b9c864" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:10 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Volume volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e (7c7c318d-22aa-4e83-ad40-1dfc393b8a2e): created successfully Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e329aff-b862-4977-aaf6-bbd2bb58177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Flow 'volume_create_manager' (76c34807-5263-45a8-9bff-394b5157560e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a6753166-712f-4910-b58a-b38c5c5b06b1 tempest-VolumesListAdminTestJSON-1614345256 None] Created volume successfully. Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-157aae4d-37ad-4335-ad9e-a63f14b9c864" acquired by "_delete_snapshot" :: waited 0.094s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Deleting offline snapshot 157aae4d-37ad-4335-ad9e-a63f14b9c864 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] snapshot_file for this snap is: volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2006a1b-7813-4836-890b-0a6b5a60f07c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:10 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 Apr 24 19:55:10 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:11 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864" returned: 0 in 0.761s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c34d1c7-f0c1-4d85-bb57-24a925828a26]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Flow 'volume_create_manager' (24d15e9f-6abd-48e0-84b4-1d3e932af8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7027c7c2-bfcb-4502-8f07-959c4c2b4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7027c7c2-bfcb-4502-8f07-959c4c2b4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-136174820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245693c1-13e1-4f27-be55-1890470bf632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039696c035e34bfabdb7b63031e8285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:12Z,use_quota=True,user_id='c299042d62084a25807b069dad162dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c7e0b9-1477-4a2e-a924-14cff500c61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c7e0b9-1477-4a2e-a924-14cff500c61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77520eec-4b50-4c98-94f2-dec469bffb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77520eec-4b50-4c98-94f2-dec469bffb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245693c1-13e1-4f27-be55-1890470bf632', 'volume_name': 'volume-245693c1-13e1-4f27-be55-1890470bf632', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c03b996-26cf-414c-8f05-b4c4ac518857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:11 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c03b996-26cf-414c-8f05-b4c4ac518857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7122fb2e-4411-4b68-8241-289c6cc5c796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Volume 245693c1-13e1-4f27-be55-1890470bf632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245693c1-13e1-4f27-be55-1890470bf632', 'volume_size': 1} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-136174820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245693c1-13e1-4f27-be55-1890470bf632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039696c035e34bfabdb7b63031e8285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:12Z,use_quota=True,user_id='c299042d62084a25807b069dad162dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Creating volume 245693c1-13e1-4f27-be55-1890470bf632 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:11 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:11 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632 1073741824 Apr 24 19:55:11 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Flow 'volume_create_manager' (331a7e75-40db-455c-9698-3dce35ee41a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e3459d-5287-44ca-873d-a402ac29069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e3459d-5287-44ca-873d-a402ac29069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2084992983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fc6428-5f01-4333-a860-573b25e94fec,host='devstack@QuobyteHD#QuobyteHD',id=f9d44e65-2449-441d-a57e-a20cf715db3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5662f1e0ae684558a23f8f84c09eccb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:12Z,use_quota=True,user_id='265d74ee480c499faf3ecf60cc1cb094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(deb9c56d-ff37-4ccc-a3c1-231d3266e6ad),volume_type_id=deb9c56d-ff37-4ccc-a3c1-231d3266e6ad)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbc7475-7ee3-42d4-a81e-111914ecd1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbc7475-7ee3-42d4-a81e-111914ecd1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f3b669-75b7-4217-9f4a-9758a122b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f3b669-75b7-4217-9f4a-9758a122b177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d44e65-2449-441d-a57e-a20cf715db3a', 'volume_name': 'volume-f9d44e65-2449-441d-a57e-a20cf715db3a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e394e02-793c-4a44-affe-07ef3f5ad571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e394e02-793c-4a44-affe-07ef3f5ad571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ded2780-0784-42a6-9652-f250a5ff6457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:11 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Volume f9d44e65-2449-441d-a57e-a20cf715db3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d44e65-2449-441d-a57e-a20cf715db3a', 'volume_size': 1} Apr 24 19:55:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:12 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.598s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:12 devstack sudo[86119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 Apr 24 19:55:12 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:12 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632 1073741824" returned: 0 in 0.762s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:12 devstack sudo[86121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632 Apr 24 19:55:12 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:12 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864" returned: 0 in 0.715s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:12 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864 Apr 24 19:55:12 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:13 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632" returned: 0 in 0.572s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56fc6428-5f01-4333-a860-573b25e94fec,created_at=2026-04-24T17:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2084992983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fc6428-5f01-4333-a860-573b25e94fec,host='devstack@QuobyteHD#QuobyteHD',id=f9d44e65-2449-441d-a57e-a20cf715db3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5662f1e0ae684558a23f8f84c09eccb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:12Z,use_quota=True,user_id='265d74ee480c499faf3ecf60cc1cb094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(deb9c56d-ff37-4ccc-a3c1-231d3266e6ad),volume_type_id=deb9c56d-ff37-4ccc-a3c1-231d3266e6ad)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Creating volume f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:13 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:13 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a 1073741824 Apr 24 19:55:13 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7122fb2e-4411-4b68-8241-289c6cc5c796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245693c1-13e1-4f27-be55-1890470bf632', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c83fbd1-e6a3-4f6a-8347-ad28529eab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:13 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Volume volume-245693c1-13e1-4f27-be55-1890470bf632 (245693c1-13e1-4f27-be55-1890470bf632): created successfully Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c83fbd1-e6a3-4f6a-8347-ad28529eab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Flow 'volume_create_manager' (24d15e9f-6abd-48e0-84b4-1d3e932af8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:13 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-56703113-e682-410a-9efa-3fd31e6e6676 tempest-VolumesListAdminTestJSON-1614345256 None] Created volume successfully. Apr 24 19:55:13 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.157aae4d-37ad-4335-ad9e-a63f14b9c864" returned: 0 in 0.542s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-157aae4d-37ad-4335-ad9e-a63f14b9c864" released by "_delete_snapshot" :: held 2.785s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" released by "delete_snapshot" :: held 2.887s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Created reservations ['741ff865-03d7-475f-b86b-5912a4e94622', '19b15bc9-c2a2-4fe4-8f44-277f058aa061', '6bcef512-3d26-4a75-ab11-398d61db970f', 'adfa8540-ec24-43d0-96f9-e81c8b325050'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:13 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Delete snapshot completed successfully. Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a39c5769-e67d-4555-a560-778dcc017e0d tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-157aae4d-37ad-4335-ad9e-a63f14b9c864-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:13 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a 1073741824" returned: 0 in 0.828s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:13 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a Apr 24 19:55:13 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Flow 'volume_create_manager' (3291edf3-3cca-4a92-ba98-825aa7dd2a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1c064e-930b-4ab0-929c-214982dfa54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1c064e-930b-4ab0-929c-214982dfa54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2885f5b6-41b4-4476-ae59-c9046d076d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84df9494fbf49ca976c10879d756bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:14Z,use_quota=True,user_id='506c17a2775f4acc9ad10310dcabad75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddebb637-f3dd-499b-92cb-d26f8e0ade88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddebb637-f3dd-499b-92cb-d26f8e0ade88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4eef5b-5fc1-47f6-b654-e6bd59846e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4eef5b-5fc1-47f6-b654-e6bd59846e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2885f5b6-41b4-4476-ae59-c9046d076d6b', 'volume_name': 'volume-2885f5b6-41b4-4476-ae59-c9046d076d6b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e5f515-2b1b-401c-aae6-de226a6d0088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e5f515-2b1b-401c-aae6-de226a6d0088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904cf189-1052-4d6c-8b41-9307e65e6104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:14 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Volume 2885f5b6-41b4-4476-ae59-c9046d076d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2885f5b6-41b4-4476-ae59-c9046d076d6b', 'volume_size': 1} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:14 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a" returned: 0 in 0.546s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.441s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ded2780-0784-42a6-9652-f250a5ff6457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d44e65-2449-441d-a57e-a20cf715db3a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bcaad6-820c-4cda-903c-a4489e3878ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Creating offline snapshot 6c305c67-65a9-4357-a462-b65851721c22 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:55:14 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Volume volume-f9d44e65-2449-441d-a57e-a20cf715db3a (f9d44e65-2449-441d-a57e-a20cf715db3a): created successfully Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bcaad6-820c-4cda-903c-a4489e3878ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Flow 'volume_create_manager' (331a7e75-40db-455c-9698-3dce35ee41a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[54731f3b-ef56-4283-8e61-c4d6f2dfd7ab]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:14 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-768fcb2d-b07f-4054-b112-4edf8ed555c6 tempest-GroupSnapshotsTest-941597013 None] Created volume successfully. Apr 24 19:55:14 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:14 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:15 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.548s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:15 devstack sudo[86162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 1G Apr 24 19:55:15 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:15 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] GroupSnapshot 27947007-6bee-4398-ab59-b0af78178898: creating. Apr 24 19:55:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Group snapshot 27947007-6bee-4398-ab59-b0af78178898: creating. {{(pid=81641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:55:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:15 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 1G" returned: 0 in 0.689s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:15 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 Apr 24 19:55:15 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:16 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22" returned: 0 in 0.518s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:16 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 is being set with open permissions: ugo+rw Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:16 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 Apr 24 19:55:16 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:16 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22" returned: 0 in 0.456s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.333s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.412s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2885f5b6-41b4-4476-ae59-c9046d076d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84df9494fbf49ca976c10879d756bbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:14Z,use_quota=True,user_id='506c17a2775f4acc9ad10310dcabad75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Creating volume 2885f5b6-41b4-4476-ae59-c9046d076d6b {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:16 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:16 devstack sudo[86177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b 1073741824 Apr 24 19:55:16 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:16 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2a33ee5c-90c2-4258-b01a-04423b6253e3 tempest-SnapshotsActionsTest-781993171 None] Create snapshot completed successfully Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-6c305c67-65a9-4357-a462-b65851721c22-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-6c305c67-65a9-4357-a462-b65851721c22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-quobyte-6c305c67-65a9-4357-a462-b65851721c22" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-6c305c67-65a9-4357-a462-b65851721c22" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Deleting offline snapshot 6c305c67-65a9-4357-a462-b65851721c22 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] snapshot_file for this snap is: volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:55:17 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b 1073741824" returned: 0 in 0.765s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[45992c3d-f5b8-4319-b489-037b780ac271]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:17 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b Apr 24 19:55:17 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:17 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 Apr 24 19:55:17 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:18 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b" returned: 0 in 0.483s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.688s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Creating offline snapshot c3b7887f-b888-47af-b0f1-349ce06fd731 of volume f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904cf189-1052-4d6c-8b41-9307e65e6104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2885f5b6-41b4-4476-ae59-c9046d076d6b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a454631-3f3e-4ace-bdf4-5cd0f321f538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:18 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Volume volume-2885f5b6-41b4-4476-ae59-c9046d076d6b (2885f5b6-41b4-4476-ae59-c9046d076d6b): created successfully Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a454631-3f3e-4ace-bdf4-5cd0f321f538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Flow 'volume_create_manager' (3291edf3-3cca-4a92-ba98-825aa7dd2a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1a121-3400-420b-85a9-ab3402e25d85]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:18 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22" returned: 0 in 0.611s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:18 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-384ea603-7d7c-4a55-bef5-43d2d1ad8966 tempest-VolumesListAdminTestJSON-1056308766 None] Created volume successfully. Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7387e0c6-091e-4c58-965f-24f9d6074f19]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:18 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a Apr 24 19:55:18 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:18 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:18 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Acquiring lock "cinder-2885f5b6-41b4-4476-ae59-c9046d076d6b-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Lock "cinder-2885f5b6-41b4-4476-ae59-c9046d076d6b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:19 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a" returned: 0 in 0.827s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Acquiring lock "cinder-quobyte-2885f5b6-41b4-4476-ae59-c9046d076d6b" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:19 devstack sudo[86239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 1G Apr 24 19:55:19 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Lock "cinder-quobyte-2885f5b6-41b4-4476-ae59-c9046d076d6b" acquired by "delete_volume" :: waited 0.029s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d684cd7-efd4-42b9-810b-f876762708a8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "cinder-245693c1-13e1-4f27-be55-1890470bf632-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-245693c1-13e1-4f27-be55-1890470bf632-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:19 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 1.082s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "cinder-quobyte-245693c1-13e1-4f27-be55-1890470bf632" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-quobyte-245693c1-13e1-4f27-be55-1890470bf632" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:19 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 Apr 24 19:55:19 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[67315b4c-e45b-4f5b-867e-87a391baa88b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:19 devstack sudo[86248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b Apr 24 19:55:19 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:19 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632 Apr 24 19:55:19 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:20 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 1G" returned: 0 in 1.202s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d44e65-2449-441d-a57e-a20cf715db3a -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:20 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d44e65-2449-441d-a57e-a20cf715db3a -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 Apr 24 19:55:20 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:20 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b" returned: 0 in 1.106s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:20 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b Apr 24 19:55:20 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:20 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:20 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22" returned: 0 in 1.120s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632" returned: 0 in 1.016s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:20 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632 Apr 24 19:55:20 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:20 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22 Apr 24 19:55:20 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:21 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d44e65-2449-441d-a57e-a20cf715db3a -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731" returned: 0 in 0.950s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:21 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:21 devstack sudo[86281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 Apr 24 19:55:21 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:21 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-245693c1-13e1-4f27-be55-1890470bf632" returned: 0 in 0.886s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-quobyte-245693c1-13e1-4f27-be55-1890470bf632" released by "delete_volume" :: held 1.978s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Created reservations ['85cb73e3-7f3d-4477-a77c-06ae997feafa', 'd8733cb4-7b79-44e3-b892-602ee357ed3c', '8129f5f5-cc6c-4366-9142-3d21280d48e4', 'b3b84426-839a-4f81-a844-a41e0396c0fe'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:21 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.6c305c67-65a9-4357-a462-b65851721c22" returned: 0 in 1.066s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-6c305c67-65a9-4357-a462-b65851721c22" released by "_delete_snapshot" :: held 4.055s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" released by "delete_snapshot" :: held 4.108s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:21 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:21 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:21 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2885f5b6-41b4-4476-ae59-c9046d076d6b" returned: 0 in 1.369s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Lock "cinder-quobyte-2885f5b6-41b4-4476-ae59-c9046d076d6b" released by "delete_volume" :: held 2.611s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Created reservations ['7c625b07-6d55-4d8a-b196-f8a9634a84d1', 'e0c8b54e-66d3-42c0-b039-985f386dee2e', '533360bf-b34d-4a01-af9c-4eb1e3ba813c', '5021ca60-7ae9-424d-92d6-7d842b63ff5d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Created reservations ['4c0c2308-a1a3-4643-ad0c-6c057527516b', '06f9d097-01a0-48d9-aa2a-7f914ef14ee4', 'e8c80c4f-b92a-4b12-8a92-f301cb83a880', 'd8d009dc-1071-4e43-9422-b3d3e77339a7'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:21 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731" returned: 0 in 0.780s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:22 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Delete snapshot completed successfully. Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-03a0160c-2dd0-49d4-bb90-221e99895608 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-6c305c67-65a9-4357-a462-b65851721c22-delete_snapshot" released by "delete_snapshot" :: held 4.597s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:22 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.info Apr 24 19:55:22 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:22 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:22 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:22 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.778s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:22 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Deleted volume successfully. Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5fa10cc-71fd-4e7f-acac-b8bda08c3c7a tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-245693c1-13e1-4f27-be55-1890470bf632-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:22 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.565s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:22 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Deleted volume successfully. Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7ac4090e-e1b5-47f9-8e8a-2c1dbd3c2dbb tempest-VolumesListAdminTestJSON-1056308766 None] Lock "cinder-2885f5b6-41b4-4476-ae59-c9046d076d6b-delete_volume" released by "delete_volume" :: held 3.711s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "cinder-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "cinder-quobyte-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-quobyte-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd93ab9-c2e2-4382-bbf1-bba696b86c3c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:23 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.info" returned: 0 in 0.913s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:23 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:23 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e Apr 24 19:55:23 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:23 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.info Apr 24 19:55:23 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:23 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e" returned: 0 in 0.626s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:23 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e Apr 24 19:55:23 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:23 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.info" returned: 0 in 0.580s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.467s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.345s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Creating offline snapshot b1d5178b-0e40-4f6a-bedc-0cbafd46df75 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00e01b7-25db-4805-8ddb-99056b8e43d1]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:23 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b7f34b0c-ce32-4892-ae8d-1b8a67562738 tempest-GroupSnapshotsTest-941597013 None] group_snapshot 27947007-6bee-4398-ab59-b0af78178898: created successfully Apr 24 19:55:23 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:23 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:24 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e" returned: 0 in 0.850s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-quobyte-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e" released by "delete_volume" :: held 1.543s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Created reservations ['db90ce9d-f5d1-4b26-8b26-bf6f44e7dad5', 'd00485b2-4573-4cb8-89ca-4fa8dc5521e9', '49a4e2c1-65de-437b-976c-9838deef816e', '9f523c2a-7e36-4cc9-b86e-6bdac2cb89e6'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:24 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:24 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:24 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.902s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:24 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 1G Apr 24 19:55:24 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:25 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.532s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:25 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Deleted volume successfully. Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dea5165f-2295-4039-a23f-e4c6588ac7e2 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-7c7c318d-22aa-4e83-ad40-1dfc393b8a2e-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "cinder-5c6002a4-f846-462e-bffc-ec728a5e0974-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-5c6002a4-f846-462e-bffc-ec728a5e0974-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "cinder-quobyte-5c6002a4-f846-462e-bffc-ec728a5e0974" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-quobyte-5c6002a4-f846-462e-bffc-ec728a5e0974" acquired by "delete_volume" :: waited 0.035s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ff6294-8fd0-495e-a480-8c3f16ac165f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:25 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974 Apr 24 19:55:25 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:25 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 1G" returned: 0 in 0.880s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:25 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 Apr 24 19:55:25 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:26 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974" returned: 0 in 0.583s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:26 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974 Apr 24 19:55:26 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:26 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75" returned: 0 in 0.545s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:26 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 is being set with open permissions: ugo+rw Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:26 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 Apr 24 19:55:26 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:26 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75" returned: 0 in 0.677s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.235s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.621s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-c3b7887f-b888-47af-b0f1-349ce06fd731-493a3f74-0b10-46f1-8e05-80f108b0b457" by "_create_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:26 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-671e0379-4582-41e4-b77e-04d0ebe95901 tempest-SnapshotsActionsTest-781993171 None] Create snapshot completed successfully Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-c3b7887f-b888-47af-b0f1-349ce06fd731-493a3f74-0b10-46f1-8e05-80f108b0b457" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Creating volume 493a3f74-0b10-46f1-8e05-80f108b0b457 from snapshot c3b7887f-b888-47af-b0f1-349ce06fd731 {{(pid=81641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-493a3f74-0b10-46f1-8e05-80f108b0b457" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-493a3f74-0b10-46f1-8e05-80f108b0b457" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] snapshot: c3b7887f-b888-47af-b0f1-349ce06fd731, volume: 493a3f74-0b10-46f1-8e05-80f108b0b457, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa96594-274d-4603-8bd5-79ab94505cec]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:27 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5c6002a4-f846-462e-bffc-ec728a5e0974" returned: 0 in 1.104s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:27 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 Apr 24 19:55:27 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-quobyte-5c6002a4-f846-462e-bffc-ec728a5e0974" released by "delete_volume" :: held 1.787s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Created reservations ['684fccd4-7742-4207-8e70-5748d943fa22', 'f43fe1fd-7df6-4731-aa55-e55aa444e000', 'bf6a8a69-e441-476e-acd8-7d37420f7f24', 'bd760206-d73d-4c37-a1f1-736c72940db5'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:27 devstack sudo[86456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:27 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-b1d5178b-0e40-4f6a-bedc-0cbafd46df75-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-b1d5178b-0e40-4f6a-bedc-0cbafd46df75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Acquiring lock "cinder-quobyte-b1d5178b-0e40-4f6a-bedc-0cbafd46df75" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-b1d5178b-0e40-4f6a-bedc-0cbafd46df75" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Deleting offline snapshot b1d5178b-0e40-4f6a-bedc-0cbafd46df75 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] snapshot_file for this snap is: volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[75344856-0556-4234-a611-d6bbdf5dae52]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:27 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731" returned: 0 in 0.873s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9d44e65-2449-441d-a57e-a20cf715db3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[df228fe6-75e4-47a3-921b-78a393acce76]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:28 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 Apr 24 19:55:28 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:28 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a Apr 24 19:55:28 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:28 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.068s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:28 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:28 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Deleted volume successfully. Apr 24 19:55:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-380e36ad-0988-4de6-8b5c-61d03c6f3d45 tempest-VolumesListAdminTestJSON-1614345256 None] Lock "cinder-5c6002a4-f846-462e-bffc-ec728a5e0974-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:29 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:29 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a" returned: 0 in 1.364s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:29 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:55:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75" returned: 0 in 1.444s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:29 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 Apr 24 19:55:29 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:29 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[229077b7-8da8-4b4a-8ad2-9f6f90248592]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:29 devstack sudo[86476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:29 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:30 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 1.181s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:30 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 Apr 24 19:55:30 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:32 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75" returned: 0 in 1.611s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:32 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75 Apr 24 19:55:32 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:33 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.b1d5178b-0e40-4f6a-bedc-0cbafd46df75" returned: 0 in 1.103s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-b1d5178b-0e40-4f6a-bedc-0cbafd46df75" released by "_delete_snapshot" :: held 5.510s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" released by "delete_snapshot" :: held 5.544s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:33 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Created reservations ['f22e8e13-b636-4958-9f60-08615f46fce8', '6854d16d-6294-4893-a76d-6d56e7f7939b', 'efa62991-f05c-468d-bb56-901b5c871603', '0b961ac8-1909-4cf1-8a40-014d27004aeb'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:33 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Delete snapshot completed successfully. Apr 24 19:55:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d64974eb-f7c2-4ff7-9a05-8967b9111c05 tempest-SnapshotsActionsTest-1084405803 None] Lock "cinder-b1d5178b-0e40-4f6a-bedc-0cbafd46df75-delete_snapshot" released by "delete_snapshot" :: held 5.879s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:34 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-121a0104-3cad-4a3f-9102-7b7944b0957f tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Terminate volume connection completed successfully. Apr 24 19:55:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-121a0104-3cad-4a3f-9102-7b7944b0957f tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Deleting attachment affc794d-a4fa-4444-87be-f413323c25f9. {{(pid=81641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:55:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "cinder-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "cinder-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "cinder-quobyte-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "cinder-quobyte-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" acquired by "delete_volume" :: waited 0.041s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "cinder-3c58d361-baff-46a3-8c82-0506bf37b389-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-3c58d361-baff-46a3-8c82-0506bf37b389-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b14fda-acbf-4f89-bdef-4277b43e2344]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" acquired by "delete_snapshot" :: waited 0.060s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "cinder-quobyte-3c58d361-baff-46a3-8c82-0506bf37b389" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-quobyte-3c58d361-baff-46a3-8c82-0506bf37b389" acquired by "_delete_snapshot" :: waited 0.079s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:35 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 Apr 24 19:55:35 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Deleting offline snapshot 3c58d361-baff-46a3-8c82-0506bf37b389 of volume 9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] snapshot_file for this snap is: volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e50c5e1-15a2-4128-b196-0007702fd445]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:35 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:35 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:36 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" returned: 0 in 1.440s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:36 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457" returned: 0 in 7.385s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:36 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aa88a3-15e8-4fc0-92e2-32df52921dfd]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:36 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 Apr 24 19:55:36 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:36 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a Apr 24 19:55:36 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:36 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 1.441s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af8a362-982c-490c-b87c-c8950cf43b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:36 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ee1444-1343-4dbc-a1ae-f07c24991cd8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:37 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 Apr 24 19:55:37 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:37 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" returned: 1 in 0.795s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:55:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:37 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27 Apr 24 19:55:37 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:37 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a" returned: 0 in 0.911s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:37 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:55:37 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Converted 1024.00 MB image at 138.63 MB/s Apr 24 19:55:37 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:55:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:37 devstack sudo[86554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 Apr 24 19:55:37 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:37 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29" returned: 0 in 0.774s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:37 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:37 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:38 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" returned: 0 in 0.679s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "cinder-quobyte-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27" released by "delete_volume" :: held 3.175s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG cinder.quota [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Created reservations ['dc728df6-2ba3-478e-9dde-06c90fbe1cc4', '23541345-3410-468e-924f-3f35649abed3', 'f29379e4-7b0c-4cdb-8c66-753a5994d2fd', 'fad4f67e-e206-4ba7-bbec-ef719b199320'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:38 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457" returned: 0 in 0.667s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-493a3f74-0b10-46f1-8e05-80f108b0b457" released by "_copy_volume_from_snapshot" :: held 11.407s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-c3b7887f-b888-47af-b0f1-349ce06fd731-493a3f74-0b10-46f1-8e05-80f108b0b457" released by "_create_volume_from_snapshot" :: held 11.497s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.542s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:38 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:38 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:38 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a64bd35f-7017-4d8d-8d5f-3cfbad105b28 tempest-GroupSnapshotsTest-941597013 None] Create group from source-snapshot-27947007-6bee-4398-ab59-b0af78178898 completed successfully. Apr 24 19:55:38 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.962s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:38 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389 Apr 24 19:55:38 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:39 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.684s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG cinder.manager [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Deleted volume successfully. Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-493a3f74-0b10-46f1-8e05-80f108b0b457" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-74190ce1-08f6-47e8-8990-34c251aa64ac req-22f84d1c-f68b-495a-b552-00df45982da0 tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "cinder-e48cc3ae-d75a-4eb5-96dd-22d524f8ec27-delete_volume" released by "delete_volume" :: held 4.328s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-493a3f74-0b10-46f1-8e05-80f108b0b457" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9589f7dc-9d04-44c3-8748-cef3c1b3437e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:39 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 Apr 24 19:55:39 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:39 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29.3c58d361-baff-46a3-8c82-0506bf37b389" returned: 0 in 0.711s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-quobyte-3c58d361-baff-46a3-8c82-0506bf37b389" released by "_delete_snapshot" :: held 4.127s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" released by "delete_snapshot" :: held 4.214s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Created reservations ['04b1238b-bc28-496a-8b4f-ad5064ff3ab1', 'aa730b8c-faa3-4507-95dc-e423935fae94', 'f0baea00-3d8d-4e64-acd4-1f1b763d7c57', 'bd7c72de-ef46-4578-8639-bf2b3763e8db'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Delete snapshot completed successfully. Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3eae7f2d-a91a-4639-9733-b52770224e5f tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-3c58d361-baff-46a3-8c82-0506bf37b389-delete_snapshot" released by "delete_snapshot" :: held 4.433s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:39 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457" returned: 0 in 0.672s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:39 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457 Apr 24 19:55:39 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:40 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-493a3f74-0b10-46f1-8e05-80f108b0b457" returned: 0 in 0.683s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-493a3f74-0b10-46f1-8e05-80f108b0b457" released by "delete_volume" :: held 1.422s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Created reservations ['0755c157-7b17-4d85-a4a4-574daafdc25c'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "cinder-9af8a362-982c-490c-b87c-c8950cf43b29-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:40 devstack cinder-volume[81641]: WARNING cinder.quota [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-662735980 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-662735980, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:55:40 devstack cinder-volume[81641]: WARNING cinder.quota [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-662735980 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-662735980, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-9af8a362-982c-490c-b87c-c8950cf43b29-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Created reservations ['d8452e28-520d-4798-83e2-24ddb0cd8434', '66faefa9-aa35-405a-b1f5-50e1907982a9', '116ff7fa-2cd2-449c-9526-e17d4bbdcb23', 'f4ce02ea-1a21-433c-a6e5-4ac37dd25be6'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Flow 'volume_create_manager' (78e95180-bbb1-4734-9950-a4c6fc0ce3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16f6a67-4e56-49d8-829f-e7dc916d9252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16f6a67-4e56-49d8-829f-e7dc916d9252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-737419494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611c532c-536e-4fd2-aae5-605d9d251d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cfff82e22f540fea7080904449c548f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:41Z,use_quota=True,user_id='d567bb32e4694553a8c02bfd049b2419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12303a7b-37f7-4a8f-b31a-b8f79afc1544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12303a7b-37f7-4a8f-b31a-b8f79afc1544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc6c74c-455f-426a-b482-d2e1ed19c92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc6c74c-455f-426a-b482-d2e1ed19c92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611c532c-536e-4fd2-aae5-605d9d251d2b', 'volume_name': 'volume-611c532c-536e-4fd2-aae5-605d9d251d2b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e089d528-1ae2-400f-b930-b59520bbabf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e089d528-1ae2-400f-b930-b59520bbabf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2423556b-7066-4650-932a-0869dc66fa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:41 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Volume 611c532c-536e-4fd2-aae5-605d9d251d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611c532c-536e-4fd2-aae5-605d9d251d2b', 'volume_size': 1} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-737419494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611c532c-536e-4fd2-aae5-605d9d251d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cfff82e22f540fea7080904449c548f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:41Z,use_quota=True,user_id='d567bb32e4694553a8c02bfd049b2419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Creating volume 611c532c-536e-4fd2-aae5-605d9d251d2b {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:41 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:41 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b 1073741824 Apr 24 19:55:41 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" acquired by "delete_volume" :: waited 0.109s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c901d24-f727-45ec-af01-9a5f31e10005]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:41 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 Apr 24 19:55:41 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:41 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:41 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:41 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] group_snapshot 27947007-6bee-4398-ab59-b0af78178898: deleting Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] group_snapshot 27947007-6bee-4398-ab59-b0af78178898: deleting {{(pid=81641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-f9d44e65-2449-441d-a57e-a20cf715db3a" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-f9d44e65-2449-441d-a57e-a20cf715db3a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-c3b7887f-b888-47af-b0f1-349ce06fd731" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-c3b7887f-b888-47af-b0f1-349ce06fd731" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Deleting offline snapshot c3b7887f-b888-47af-b0f1-349ce06fd731 of volume f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] snapshot_file for this snap is: volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5971451c-59d6-4cbf-aff0-32fb917ca96e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:41 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 Apr 24 19:55:41 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:41 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.733s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:41 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5e3f65c8-35d7-4923-9b6a-84a8d97304e2 tempest-GroupSnapshotsTest-941597013 None] Delete group completed successfully. Apr 24 19:55:41 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b 1073741824" returned: 0 in 0.950s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:42 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29" returned: 0 in 0.876s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:42 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29 Apr 24 19:55:42 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:42 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b Apr 24 19:55:42 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:42 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731" returned: 0 in 0.658s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9d44e65-2449-441d-a57e-a20cf715db3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cab760-68f6-41e8-bc97-97ee5469d3c5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:42 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a Apr 24 19:55:42 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:42 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9af8a362-982c-490c-b87c-c8950cf43b29" returned: 0 in 0.560s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-quobyte-9af8a362-982c-490c-b87c-c8950cf43b29" released by "delete_volume" :: held 1.499s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:42 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Created reservations ['b9886c21-c76e-4c13-839c-a3b94d5ab2d4', 'b8d3f929-ece7-4fbc-a769-61c226bff4ba', '9a5dd312-fdf2-4154-91ca-50b91d171053', 'f893d65b-8daa-4a60-87c5-8a0b1d45c932'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b" returned: 0 in 0.588s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2423556b-7066-4650-932a-0869dc66fa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611c532c-536e-4fd2-aae5-605d9d251d2b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0936a7d6-b074-405c-ab37-c3cb8fc90743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:42 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Volume volume-611c532c-536e-4fd2-aae5-605d9d251d2b (611c532c-536e-4fd2-aae5-605d9d251d2b): created successfully Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0936a7d6-b074-405c-ab37-c3cb8fc90743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Flow 'volume_create_manager' (78e95180-bbb1-4734-9950-a4c6fc0ce3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:42 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e625cd97-f162-4571-9eb5-b378f28cfe35 tempest-AbsoluteLimitsTests-336209050 None] Created volume successfully. Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:42 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:42 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:43 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a" returned: 0 in 0.673s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:43 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 Apr 24 19:55:43 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Acquiring lock "cinder-611c532c-536e-4fd2-aae5-605d9d251d2b-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Lock "cinder-611c532c-536e-4fd2-aae5-605d9d251d2b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Acquiring lock "cinder-quobyte-611c532c-536e-4fd2-aae5-605d9d251d2b" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:43 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.743s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:43 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Deleted volume successfully. Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Lock "cinder-quobyte-611c532c-536e-4fd2-aae5-605d9d251d2b" acquired by "delete_volume" :: waited 0.043s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f76bc68d-f659-44bb-be3b-69c2d544c745 tempest-SnapshotsActionsTest-781993171 None] Lock "cinder-9af8a362-982c-490c-b87c-c8950cf43b29-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5397b31-5b66-4c46-ab62-24a63635fc1d]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:43 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b Apr 24 19:55:43 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:43 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731" returned: 0 in 0.820s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:43 devstack sudo[86649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731 Apr 24 19:55:43 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:44 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b" returned: 0 in 0.682s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:44 devstack sudo[86654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b Apr 24 19:55:44 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:44 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a.c3b7887f-b888-47af-b0f1-349ce06fd731" returned: 0 in 0.722s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-c3b7887f-b888-47af-b0f1-349ce06fd731" released by "_delete_snapshot" :: held 2.981s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-f9d44e65-2449-441d-a57e-a20cf715db3a" released by "delete_snapshot" :: held 3.035s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:44 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-611c532c-536e-4fd2-aae5-605d9d251d2b" returned: 0 in 0.521s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Lock "cinder-quobyte-611c532c-536e-4fd2-aae5-605d9d251d2b" released by "delete_volume" :: held 1.276s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:44 devstack cinder-volume[81641]: WARNING cinder.quota [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-662735980 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-662735980, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Created reservations ['ad8c35b8-c833-48ef-b44c-56f287abc5a2', 'c1319d71-a951-42a3-8d57-4e7a3bfa3183', '4e539a59-0498-42f5-82b1-d1b7c93befc7', 'cc48272f-2993-49ae-9eb4-a5cc4da44096'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] Created reservations ['bafc021d-74a0-4009-b6de-256ab8f9bdfc', '4cea2d26-e003-4225-931a-d65efed109ff', 'f0a00a44-08bb-47a5-9bae-b81e36d01d46', 'e5bfdba0-a786-49c1-a9c5-201bae9e382b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:44 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3f17d477-607d-47ec-8210-db82cf5ecbd0 tempest-GroupSnapshotsTest-941597013 None] group_snapshot 27947007-6bee-4398-ab59-b0af78178898: deleted successfully Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:45 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:45 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-f9d44e65-2449-441d-a57e-a20cf715db3a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-f9d44e65-2449-441d-a57e-a20cf715db3a" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[543de434-678b-4431-ba7c-75ff2413df7c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:45 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a Apr 24 19:55:45 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:45 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.611s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:45 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Deleted volume successfully. Apr 24 19:55:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dcf860f9-d588-44e8-bbf6-4df6e1a93ef0 tempest-AbsoluteLimitsTests-336209050 None] Lock "cinder-611c532c-536e-4fd2-aae5-605d9d251d2b-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:46 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a" returned: 0 in 0.745s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:46 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a Apr 24 19:55:46 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:46 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f9d44e65-2449-441d-a57e-a20cf715db3a" returned: 0 in 0.489s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-f9d44e65-2449-441d-a57e-a20cf715db3a" released by "delete_volume" :: held 1.304s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Created reservations ['64e3b32c-621f-4ab5-93ca-8a9c106cd170'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:46 devstack cinder-volume[81641]: WARNING cinder.db.sqlalchemy.api [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-662735980'] Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Created reservations ['d7a87ba3-0c94-4499-b58f-d2b963ffb601', 'f73ae1bd-aa9c-4905-a6f8-f06817bae635', '62131560-7647-4ac9-84a7-89378d36b679', '8fdefb9b-b3e5-4834-83c5-eceaf802fc03'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:46 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:46 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:47 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.599s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:47 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:47 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1d827bb8-33e8-48d3-a84b-f8ee6c058339 tempest-GroupSnapshotsTest-941597013 None] Delete group completed successfully. Apr 24 19:55:48 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7825f40d-b4db-4d99-85bd-8c2df6ca28b5 tempest-GroupSnapshotsTest-941597013 None] Group tempest-GroupSnapshotsTest-Group-1075854683: creating Apr 24 19:55:48 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7825f40d-b4db-4d99-85bd-8c2df6ca28b5 tempest-GroupSnapshotsTest-941597013 None] Group tempest-GroupSnapshotsTest-Group-1075854683: created successfully Apr 24 19:55:48 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7825f40d-b4db-4d99-85bd-8c2df6ca28b5 tempest-GroupSnapshotsTest-941597013 None] Create group completed successfully. Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Flow 'volume_create_manager' (e022f928-13d2-40d9-a374-2d7ce0c0c172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d834b481-1eb5-4b58-a9f2-fc7ef86fa0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d834b481-1eb5-4b58-a9f2-fc7ef86fa0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1099873932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3637144-e31f-4aa4-b67e-1dafeb9c0fbb,host='devstack@QuobyteHD#QuobyteHD',id=19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5662f1e0ae684558a23f8f84c09eccb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:49Z,use_quota=True,user_id='265d74ee480c499faf3ecf60cc1cb094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a746175-9dfc-4635-8444-f08c83ae0666),volume_type_id=8a746175-9dfc-4635-8444-f08c83ae0666)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d7b453-b1f2-4f8a-b535-de27ea6d5694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d7b453-b1f2-4f8a-b535-de27ea6d5694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bc6840-d8e1-4cef-8f3a-b47f4a5058a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bc6840-d8e1-4cef-8f3a-b47f4a5058a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800', 'volume_name': 'volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536ead5c-0a2d-48f5-9f7b-a8001450c60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536ead5c-0a2d-48f5-9f7b-a8001450c60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a512de-dd63-4201-86ee-707b949cbc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Volume 19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800', 'volume_size': 1} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c3637144-e31f-4aa4-b67e-1dafeb9c0fbb,created_at=2026-04-24T17:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1099873932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3637144-e31f-4aa4-b67e-1dafeb9c0fbb,host='devstack@QuobyteHD#QuobyteHD',id=19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5662f1e0ae684558a23f8f84c09eccb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:49Z,use_quota=True,user_id='265d74ee480c499faf3ecf60cc1cb094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a746175-9dfc-4635-8444-f08c83ae0666),volume_type_id=8a746175-9dfc-4635-8444-f08c83ae0666)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Creating volume 19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:49 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:49 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 1073741824 Apr 24 19:55:49 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Flow 'volume_create_manager' (c0b10e35-b90e-426a-9ecc-cb581aff738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411f5eda-fab5-4951-b8b3-52851fb61021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411f5eda-fab5-4951-b8b3-52851fb61021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2066130205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b6d647-6e34-48b0-b408-067477ed9fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a0084e13cd4bbc8746c0ee66cfabda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:50Z,use_quota=True,user_id='b213278e6ccf40759853b7c049c6783c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52aa980b-9905-46d0-90a9-576f389a68b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52aa980b-9905-46d0-90a9-576f389a68b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3357cff5-3925-4a43-ade6-60c0a95f0d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3357cff5-3925-4a43-ade6-60c0a95f0d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b6d647-6e34-48b0-b408-067477ed9fe6', 'volume_name': 'volume-c4b6d647-6e34-48b0-b408-067477ed9fe6', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85281d10-a123-44fa-81cd-e5260fe2d3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85281d10-a123-44fa-81cd-e5260fe2d3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9428b1-1a1b-4aee-afe1-d8a0457fbf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:49 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Volume c4b6d647-6e34-48b0-b408-067477ed9fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b6d647-6e34-48b0-b408-067477ed9fe6', 'volume_size': 1} Apr 24 19:55:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:50 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 1073741824" returned: 0 in 0.861s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:50 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 Apr 24 19:55:50 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=139,cinder:INSERT=42,cinder:UPDATE=171,cinder:DELETE=9 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Flow 'volume_create_manager' (f1ea9d35-1e10-43c4-af72-6b12ab8ba40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f888faa3-d5bd-4e47-810d-47a582e3c6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f888faa3-d5bd-4e47-810d-47a582e3c6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2009781637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1502f44b-433f-4813-9e3f-58a1c16224fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035d21b24cdb4c9db07b1e99817de01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:51Z,use_quota=True,user_id='41666a38f6ce4d06be21aef0761fdf88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a9c355-d1fb-4ca2-82a2-5edd63301d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a9c355-d1fb-4ca2-82a2-5edd63301d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681a6c94-5cdd-4f34-8009-e4ed26755d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681a6c94-5cdd-4f34-8009-e4ed26755d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1502f44b-433f-4813-9e3f-58a1c16224fe', 'volume_name': 'volume-1502f44b-433f-4813-9e3f-58a1c16224fe', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cacd67-ebc6-4f91-9795-e2248367208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cacd67-ebc6-4f91-9795-e2248367208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c870922-e68e-4196-a6ac-4efe65d6f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:50 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Volume 1502f44b-433f-4813-9e3f-58a1c16224fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1502f44b-433f-4813-9e3f-58a1c16224fe', 'volume_size': 1} Apr 24 19:55:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:51 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" returned: 0 in 0.562s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2066130205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b6d647-6e34-48b0-b408-067477ed9fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30a0084e13cd4bbc8746c0ee66cfabda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:50Z,use_quota=True,user_id='b213278e6ccf40759853b7c049c6783c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Creating volume c4b6d647-6e34-48b0-b408-067477ed9fe6 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:51 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a512de-dd63-4201-86ee-707b949cbc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:51 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 1073741824 Apr 24 19:55:51 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33e705b-bf64-40fb-8ce6-4922b126976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:51 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Volume volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 (19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800): created successfully Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33e705b-bf64-40fb-8ce6-4922b126976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Flow 'volume_create_manager' (e022f928-13d2-40d9-a374-2d7ce0c0c172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:51 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f021145d-36a3-449d-bd3b-18677c35a9bf tempest-GroupSnapshotsTest-941597013 None] Created volume successfully. Apr 24 19:55:51 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-f8051160-aff8-4640-8d66-4d9a72614f6d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Terminate volume connection completed successfully. Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-f8051160-aff8-4640-8d66-4d9a72614f6d tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Deleting attachment 64cb312b-3d2f-4496-bf75-8e89d9868cdc. {{(pid=81641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:55:51 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 1073741824" returned: 0 in 0.677s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=141,cinder:UPDATE=139,cinder:DELETE=11,cinder:INSERT=34 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:51 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 Apr 24 19:55:51 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "cinder-7e437374-623d-4fd2-b31e-6464d3d796d5-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:51 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "cinder-7e437374-623d-4fd2-b31e-6464d3d796d5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "cinder-quobyte-7e437374-623d-4fd2-b31e-6464d3d796d5" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "cinder-quobyte-7e437374-623d-4fd2-b31e-6464d3d796d5" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8032b9-359e-411a-af5f-a1ab8ebf1d79]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:52 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 Apr 24 19:55:52 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Flow 'volume_create_manager' (29dc5118-3c29-45e7-9a17-385a4f7e6af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1094c43-aa56-4939-9a48-dac9fcc06d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1094c43-aa56-4939-9a48-dac9fcc06d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-714527948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3637144-e31f-4aa4-b67e-1dafeb9c0fbb,host='devstack@QuobyteHD#QuobyteHD',id=65298e85-3886-4fd8-b24c-562fca791104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5662f1e0ae684558a23f8f84c09eccb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:52Z,use_quota=True,user_id='265d74ee480c499faf3ecf60cc1cb094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a746175-9dfc-4635-8444-f08c83ae0666),volume_type_id=8a746175-9dfc-4635-8444-f08c83ae0666)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2308cb-ef91-4395-8ecc-c250b100df42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2308cb-ef91-4395-8ecc-c250b100df42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e559070e-9ff0-4624-a413-2c08337ca788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e559070e-9ff0-4624-a413-2c08337ca788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65298e85-3886-4fd8-b24c-562fca791104', 'volume_name': 'volume-65298e85-3886-4fd8-b24c-562fca791104', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf9eb3e-5a07-47f2-84a0-5e9a77902d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf9eb3e-5a07-47f2-84a0-5e9a77902d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef50051-c154-41a8-8c4c-b1cc66145526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:52 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Volume 65298e85-3886-4fd8-b24c-562fca791104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65298e85-3886-4fd8-b24c-562fca791104', 'volume_size': 1} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:52 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6" returned: 0 in 0.544s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.411s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2009781637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1502f44b-433f-4813-9e3f-58a1c16224fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035d21b24cdb4c9db07b1e99817de01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:51Z,use_quota=True,user_id='41666a38f6ce4d06be21aef0761fdf88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Creating volume 1502f44b-433f-4813-9e3f-58a1c16224fe {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:52 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9428b1-1a1b-4aee-afe1-d8a0457fbf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b6d647-6e34-48b0-b408-067477ed9fe6', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94849be0-af5e-4c86-abab-470f3821efed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:52 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe 1073741824 Apr 24 19:55:52 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:52 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Volume volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 (c4b6d647-6e34-48b0-b408-067477ed9fe6): created successfully Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94849be0-af5e-4c86-abab-470f3821efed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Flow 'volume_create_manager' (c0b10e35-b90e-426a-9ecc-cb581aff738e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:52 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5f285621-cdc5-4783-a5c5-a1c78eb30af1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Created volume successfully. Apr 24 19:55:52 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5" returned: 0 in 0.602s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:52 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5 Apr 24 19:55:52 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:53 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:53 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:53 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe 1073741824" returned: 0 in 0.755s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:53 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe Apr 24 19:55:53 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:53 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e437374-623d-4fd2-b31e-6464d3d796d5" returned: 0 in 0.584s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "cinder-quobyte-7e437374-623d-4fd2-b31e-6464d3d796d5" released by "delete_volume" :: held 1.232s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.quota [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Created reservations ['cf4255f9-d981-406c-a7fa-a19b1f910f3c', '99458aed-c24b-4158-9238-4a6367826a30', 'd0a71a25-7686-4ddd-a5c0-95035e9b4f7f', 'c25688e8-cb1d-4130-a4bb-7fed065d7019'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:53 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:55:53 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:53 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.538s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:53 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe" returned: 0 in 0.501s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c3637144-e31f-4aa4-b67e-1dafeb9c0fbb,created_at=2026-04-24T17:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-714527948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3637144-e31f-4aa4-b67e-1dafeb9c0fbb,host='devstack@QuobyteHD#QuobyteHD',id=65298e85-3886-4fd8-b24c-562fca791104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5662f1e0ae684558a23f8f84c09eccb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:55:52Z,use_quota=True,user_id='265d74ee480c499faf3ecf60cc1cb094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a746175-9dfc-4635-8444-f08c83ae0666),volume_type_id=8a746175-9dfc-4635-8444-f08c83ae0666)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Creating volume 65298e85-3886-4fd8-b24c-562fca791104 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:55:53 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:53 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 1073741824 Apr 24 19:55:53 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c870922-e68e-4196-a6ac-4efe65d6f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1502f44b-433f-4813-9e3f-58a1c16224fe', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cf40ac-360c-4cdd-bec1-bc22857faf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:53 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Volume volume-1502f44b-433f-4813-9e3f-58a1c16224fe (1502f44b-433f-4813-9e3f-58a1c16224fe): created successfully Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cf40ac-360c-4cdd-bec1-bc22857faf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Flow 'volume_create_manager' (f1ea9d35-1e10-43c4-af72-6b12ab8ba40d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:53 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8adf0b68-61ed-48d6-9363-6f65a1e04879 tempest-VolumesNegativeTest-1042372005 None] Created volume successfully. Apr 24 19:55:53 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.460s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.manager [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:55:53 devstack cinder-volume[81641]: INFO cinder.volume.manager [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Deleted volume successfully. Apr 24 19:55:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [req-c353fc17-d132-4d20-b4f9-bd6aa1bac8bd req-3b87a1fc-07fa-431c-8b5d-745094beebcb tempest-ServerBootFromVolumeStableRescueTest-2101063577 None] Lock "cinder-7e437374-623d-4fd2-b31e-6464d3d796d5-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:55:54 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 1073741824" returned: 0 in 0.732s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:54 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 Apr 24 19:55:54 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:55 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104" returned: 0 in 0.510s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.787s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef50051-c154-41a8-8c4c-b1cc66145526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65298e85-3886-4fd8-b24c-562fca791104', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f13852d-edf3-4c1e-82c8-9a8635bc0ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Creating offline snapshot bdc1eb12-9c14-4160-96cb-7e4ef7222202 of volume c4b6d647-6e34-48b0-b408-067477ed9fe6 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:55:55 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Volume volume-65298e85-3886-4fd8-b24c-562fca791104 (65298e85-3886-4fd8-b24c-562fca791104): created successfully Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f13852d-edf3-4c1e-82c8-9a8635bc0ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Flow 'volume_create_manager' (29dc5118-3c29-45e7-9a17-385a4f7e6af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f7fbaa-ea2c-447e-8e8c-d9123dbbcef0]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:55 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7469690f-16ac-4790-9d8b-b4f1e4472e5e tempest-GroupSnapshotsTest-941597013 None] Created volume successfully. Apr 24 19:55:55 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 Apr 24 19:55:55 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:55 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6" returned: 0 in 0.594s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:55 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 1G Apr 24 19:55:55 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:55 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7b1a858d-cb0f-4ee1-98b9-0a4e9e0ef7dc tempest-GroupSnapshotsTest-941597013 None] Update group completed successfully. Apr 24 19:55:56 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 1G" returned: 0 in 0.741s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:56 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 Apr 24 19:55:56 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-c2b6d75a-feff-49ed-bb71-9454f9c2895d tempest-GroupSnapshotsTest-941597013 None] Update group completed successfully. Apr 24 19:55:56 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202" returned: 0 in 0.569s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:56 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 is being set with open permissions: ugo+rw Apr 24 19:55:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:57 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 Apr 24 19:55:57 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:57 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202" returned: 0 in 0.515s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:57 devstack sudo[86779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.info Apr 24 19:55:57 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:58 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:58 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1790d966-3c8b-4f41-bf8c-d9b47cee071c tempest-GroupSnapshotsTest-941597013 None] Update group completed successfully. Apr 24 19:55:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.info" returned: 0 in 0.538s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:58 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.info is being set with open permissions: ugo+rw Apr 24 19:55:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:55:58 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.info Apr 24 19:55:58 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:55:58 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 24 19:55:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.info" returned: 0 in 0.507s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:55:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.590s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:55:58 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1260ec4d-6a3b-41a6-bd2a-440887f6c9e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Create snapshot completed successfully Apr 24 19:55:59 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4154946d-1a20-4eae-8a8a-3cc9155ad606 tempest-GroupSnapshotsTest-941597013 None] Update group completed successfully. Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Acquiring lock "cinder-bdc1eb12-9c14-4160-96cb-7e4ef7222202-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-bdc1eb12-9c14-4160-96cb-7e4ef7222202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Acquiring lock "cinder-quobyte-c4b6d647-6e34-48b0-b408-067477ed9fe6" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-quobyte-c4b6d647-6e34-48b0-b408-067477ed9fe6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Acquiring lock "cinder-quobyte-bdc1eb12-9c14-4160-96cb-7e4ef7222202" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-quobyte-bdc1eb12-9c14-4160-96cb-7e4ef7222202" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Deleting offline snapshot bdc1eb12-9c14-4160-96cb-7e4ef7222202 of volume c4b6d647-6e34-48b0-b408-067477ed9fe6 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] snapshot_file for this snap is: volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df0cc17-7a50-4a71-9bce-49cf12c48f13]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:55:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:00 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 Apr 24 19:56:00 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:00 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202" returned: 0 in 0.919s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4b6d647-6e34-48b0-b408-067477ed9fe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:00 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35fc9d6-8e06-481e-aa91-bccecbdacc72]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] GroupSnapshot 42a65cf4-225d-4d7f-bf81-a4403abc2d58: creating. Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Group snapshot 42a65cf4-225d-4d7f-bf81-a4403abc2d58: creating. {{(pid=81641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:56:01 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 Apr 24 19:56:01 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Creating offline snapshot 833dd57d-29ac-4040-b7c8-b90c98d6c851 of volume 65298e85-3886-4fd8-b24c-562fca791104 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4a7d83-da77-466b-ab6c-2067167d38c9]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:01 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 Apr 24 19:56:01 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:01 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6" returned: 0 in 0.658s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:01 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 Apr 24 19:56:01 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:01 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104" returned: 0 in 0.701s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:01 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 1G Apr 24 19:56:01 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:02 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202" returned: 0 in 0.737s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:02 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202 Apr 24 19:56:02 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:02 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 1G" returned: 0 in 0.713s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65298e85-3886-4fd8-b24c-562fca791104 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:02 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65298e85-3886-4fd8-b24c-562fca791104 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 Apr 24 19:56:02 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:02 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6.bdc1eb12-9c14-4160-96cb-7e4ef7222202" returned: 0 in 0.464s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-quobyte-bdc1eb12-9c14-4160-96cb-7e4ef7222202" released by "_delete_snapshot" :: held 2.931s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-quobyte-c4b6d647-6e34-48b0-b408-067477ed9fe6" released by "delete_snapshot" :: held 2.954s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:02 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Created reservations ['811cc77f-4661-4a2d-be5d-e581ba81e237', '3dda113b-f478-445b-b038-85b9fee08dea', 'a2ab6958-2023-42d7-b408-7f9dc3b55192', '4f4907a7-3845-4799-b225-f38fef99bfbc'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Delete snapshot completed successfully. Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-beebcde6-7a95-4c5e-9302-7cfe3db925b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-bdc1eb12-9c14-4160-96cb-7e4ef7222202-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:03 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65298e85-3886-4fd8-b24c-562fca791104 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851" returned: 0 in 0.647s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:03 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:03 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 Apr 24 19:56:03 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Acquiring lock "cinder-c4b6d647-6e34-48b0-b408-067477ed9fe6-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-c4b6d647-6e34-48b0-b408-067477ed9fe6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Acquiring lock "cinder-quobyte-c4b6d647-6e34-48b0-b408-067477ed9fe6" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-quobyte-c4b6d647-6e34-48b0-b408-067477ed9fe6" acquired by "delete_volume" :: waited 0.033s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[db716f06-edc3-4efa-a1fc-e508c5f26ecf]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:03 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 Apr 24 19:56:03 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:03 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851" returned: 0 in 0.652s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:03 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.info Apr 24 19:56:03 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:04 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6" returned: 0 in 0.622s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:04 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6 Apr 24 19:56:04 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:04 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.info" returned: 0 in 0.558s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:04 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:04 devstack sudo[86881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.info Apr 24 19:56:04 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:04 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-c4b6d647-6e34-48b0-b408-067477ed9fe6" returned: 0 in 0.575s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-quobyte-c4b6d647-6e34-48b0-b408-067477ed9fe6" released by "delete_volume" :: held 1.274s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Created reservations ['2d01352d-0d5b-4604-83b9-5d14c55ff62a', '89438929-79ef-40b6-9d99-1c9cfb6dbdde', '421f5f32-9e5d-429f-aea8-633a81f6e4a6', '1011276c-5d1d-476c-9e3a-b96057bf93c3'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:04 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:56:04 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:05 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.info" returned: 0 in 0.725s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.086s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Creating offline snapshot fcd0f7bf-71cc-43f6-a887-b30abf2cf812 of volume 19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd80756-c560-4c44-a2b6-60f80303e26e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:05 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 Apr 24 19:56:05 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:05 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.619s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:56:05 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Deleted volume successfully. Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-05c441b8-fc3a-43ad-90c7-a6b20af1b0d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1095567730 None] Lock "cinder-c4b6d647-6e34-48b0-b408-067477ed9fe6-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:05 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" returned: 0 in 0.659s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:05 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 1G Apr 24 19:56:05 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:06 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 1G" returned: 0 in 0.805s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:06 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 Apr 24 19:56:06 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:07 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812" returned: 0 in 0.641s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:07 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:56:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:07 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 Apr 24 19:56:07 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:08 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812" returned: 0 in 0.915s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:08 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.info Apr 24 19:56:08 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:09 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.info" returned: 0 in 0.998s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:09 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:56:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:09 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.info Apr 24 19:56:09 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:10 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.info" returned: 0 in 1.036s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.188s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3175d870-e85f-4714-afb3-113f44a6862a tempest-GroupSnapshotsTest-941597013 None] group_snapshot 42a65cf4-225d-4d7f-bf81-a4403abc2d58: created successfully Apr 24 19:56:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] group_snapshot 42a65cf4-225d-4d7f-bf81-a4403abc2d58: deleting Apr 24 19:56:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] group_snapshot 42a65cf4-225d-4d7f-bf81-a4403abc2d58: deleting {{(pid=81641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:56:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-65298e85-3886-4fd8-b24c-562fca791104" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-65298e85-3886-4fd8-b24c-562fca791104" acquired by "delete_snapshot" :: waited 0.048s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-833dd57d-29ac-4040-b7c8-b90c98d6c851" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-833dd57d-29ac-4040-b7c8-b90c98d6c851" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Deleting offline snapshot 833dd57d-29ac-4040-b7c8-b90c98d6c851 of volume 65298e85-3886-4fd8-b24c-562fca791104 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:56:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] snapshot_file for this snap is: volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:56:11 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c961228e-cbe2-4276-b041-f179cc9bceab]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:11 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 Apr 24 19:56:11 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:12 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851" returned: 0 in 1.179s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65298e85-3886-4fd8-b24c-562fca791104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:12 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca8822a-757a-4494-a1e0-2a85d116f6b7]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:12 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 Apr 24 19:56:12 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:13 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104" returned: 0 in 0.775s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:13 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 Apr 24 19:56:13 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6483c84e-8e13-4ca4-92d9-5d742f8dd1da tempest-BackendsCapabilitiesAdminTestsJSON-1228166302 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309837341309, 'free_capacity_gb': 1775.7309837341309, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81641) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 19:56:14 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851" returned: 0 in 0.842s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:14 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851 Apr 24 19:56:14 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8812d0d9-5d4a-48b5-aac5-b8447519abd5 tempest-BackendsCapabilitiesAdminTestsJSON-1228166302 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309837341309, 'free_capacity_gb': 1775.7309837341309, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81641) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 19:56:14 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104.833dd57d-29ac-4040-b7c8-b90c98d6c851" returned: 0 in 0.515s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-833dd57d-29ac-4040-b7c8-b90c98d6c851" released by "_delete_snapshot" :: held 3.473s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-65298e85-3886-4fd8-b24c-562fca791104" released by "delete_snapshot" :: held 3.527s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-fcd0f7bf-71cc-43f6-a887-b30abf2cf812" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-fcd0f7bf-71cc-43f6-a887-b30abf2cf812" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Deleting offline snapshot fcd0f7bf-71cc-43f6-a887-b30abf2cf812 of volume 19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] snapshot_file for this snap is: volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e060e172-96be-434b-aa0d-65c270a54e5b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:14 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 Apr 24 19:56:14 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:15 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812" returned: 0 in 0.679s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:15 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8a53be-2d7d-4ca0-bcc2-5f5adeeab116]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:15 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 Apr 24 19:56:15 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:16 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" returned: 0 in 0.619s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:16 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 Apr 24 19:56:16 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:16 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812" returned: 0 in 0.744s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:16 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812 Apr 24 19:56:16 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:17 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800.fcd0f7bf-71cc-43f6-a887-b30abf2cf812" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-fcd0f7bf-71cc-43f6-a887-b30abf2cf812" released by "_delete_snapshot" :: held 2.685s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" released by "delete_snapshot" :: held 2.726s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:17 devstack cinder-volume[81641]: WARNING cinder.quota [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1910274723 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1910274723, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:56:17 devstack cinder-volume[81641]: WARNING cinder.quota [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1910274723 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1910274723, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:56:17 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Created reservations ['0395f3a0-b151-46f7-b190-c41133e286d2', 'c7cf5837-bdf6-4625-ac7b-7b3b266948b5', 'a49022b3-ee5a-43b0-8e2c-e40c8b327a70', '0a3d2b75-ff04-48c6-a1fc-c85de56f7f40'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:17 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] Created reservations ['df3957d3-8eb0-4f80-a5e4-6846115756e4', '5ee849b9-0b54-4062-957f-f96994b7fe3b', '6dfc15c5-ad15-465c-82c1-586d735d5ce1', '2200c41d-6391-4827-a09b-47dd4bec4d62'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:17 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-afd84a0c-cfd6-4cfb-962a-50f438753bf0 tempest-GroupSnapshotsTest-941597013 None] group_snapshot 42a65cf4-225d-4d7f-bf81-a4403abc2d58: deleted successfully Apr 24 19:56:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:19 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[78187641-097b-4d78-8e6b-ec019a717309]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:19 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 Apr 24 19:56:19 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:20 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" returned: 0 in 1.246s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:20 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800 Apr 24 19:56:20 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3ebe7f56-0522-45f1-80b5-299db02000e9 tempest-GroupsV320Test-828950421 None] Group tempest-GroupsV320Test-Group-716429697: creating Apr 24 19:56:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3ebe7f56-0522-45f1-80b5-299db02000e9 tempest-GroupsV320Test-828950421 None] Group tempest-GroupsV320Test-Group-716429697: created successfully Apr 24 19:56:20 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3ebe7f56-0522-45f1-80b5-299db02000e9 tempest-GroupsV320Test-828950421 None] Create group completed successfully. Apr 24 19:56:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" returned: 0 in 0.547s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-19407bfc-fb06-4ef8-ba2d-bb4cbe9b6800" released by "delete_volume" :: held 1.884s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-65298e85-3886-4fd8-b24c-562fca791104" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-65298e85-3886-4fd8-b24c-562fca791104" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:21 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e8462-46ce-405b-ad73-391da28b487f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:21 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 Apr 24 19:56:21 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:21 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104" returned: 0 in 0.701s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:21 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104 Apr 24 19:56:21 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:22 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-65298e85-3886-4fd8-b24c-562fca791104" returned: 0 in 0.745s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-65298e85-3886-4fd8-b24c-562fca791104" released by "delete_volume" :: held 1.546s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Created reservations ['c1bd32c7-375b-4366-9320-04de6d9e3704'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:22 devstack cinder-volume[81641]: WARNING cinder.quota [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1910274723 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1910274723, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] Created reservations ['7647f491-656e-4a19-89d0-b76250e7e9c3'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Created reservations ['b4ceb573-d4d5-4acf-a5de-bcf96b5ac003', 'd8f76804-394e-43a5-9f62-7f6c98990e39', 'a5a90ccd-9e7e-4f2f-abfb-5c369138d5f4', '3996c953-52a2-467c-94bb-c1f69250a2dc'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:22 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:56:22 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:22 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Created reservations ['8f1cc7e0-fb03-43c0-a4d0-eac93b31298c', '8e344049-d0f5-46c8-a8d5-1b52531c90b4', '2635b777-50bb-41c1-803a-897b3f7b9edc', '3c423b0e-4c87-4a7a-9d48-9248a5e1d1ab'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:23 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:56:23 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:23 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.670s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:56:23 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b5713faf-ad72-4da7-b1db-c011014318be tempest-GroupsV320Test-828950421 None] Delete group completed successfully. Apr 24 19:56:23 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:23 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:56:23 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-17f90811-f301-4bac-ab9a-edb39ad2848b tempest-GroupSnapshotsTest-941597013 None] Delete group completed successfully. Apr 24 19:56:24 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d2a1f49d-4542-4c7d-9a6f-3ec27c38195b tempest-GroupSnapshotsTest-941597013 None] Group tempest-GroupSnapshotsTest-Group-1803024997: creating Apr 24 19:56:24 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d2a1f49d-4542-4c7d-9a6f-3ec27c38195b tempest-GroupSnapshotsTest-941597013 None] Group tempest-GroupSnapshotsTest-Group-1803024997: created successfully Apr 24 19:56:24 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d2a1f49d-4542-4c7d-9a6f-3ec27c38195b tempest-GroupSnapshotsTest-941597013 None] Create group completed successfully. Apr 24 19:56:25 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Flow 'volume_create_manager' (65be19b5-8e8f-4f54-ba6f-673c5e633be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95cf9fe-c2fc-4264-b7d1-e71615f41f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95cf9fe-c2fc-4264-b7d1-e71615f41f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395823559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db81e08e-65db-4c6b-b9c7-beaec3bd7374,host='devstack@QuobyteHD#QuobyteHD',id=2459311d-70e5-4fdb-8f46-1d8199a8339c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5662f1e0ae684558a23f8f84c09eccb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:26Z,use_quota=True,user_id='265d74ee480c499faf3ecf60cc1cb094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(878cb6a6-4d37-4edb-8a30-73b8104605c6),volume_type_id=878cb6a6-4d37-4edb-8a30-73b8104605c6)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04940e52-6f6f-433c-b1fc-befd0c70dd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04940e52-6f6f-433c-b1fc-befd0c70dd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5507d3e3-fda1-4037-b851-754725fcaa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5507d3e3-fda1-4037-b851-754725fcaa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2459311d-70e5-4fdb-8f46-1d8199a8339c', 'volume_name': 'volume-2459311d-70e5-4fdb-8f46-1d8199a8339c', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197e05af-12f0-4a67-9c19-513b86cb5410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197e05af-12f0-4a67-9c19-513b86cb5410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260df371-aab8-4626-8f5e-b311c314f475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:26 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Volume 2459311d-70e5-4fdb-8f46-1d8199a8339c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2459311d-70e5-4fdb-8f46-1d8199a8339c', 'volume_size': 1} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db81e08e-65db-4c6b-b9c7-beaec3bd7374,created_at=2026-04-24T17:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-395823559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db81e08e-65db-4c6b-b9c7-beaec3bd7374,host='devstack@QuobyteHD#QuobyteHD',id=2459311d-70e5-4fdb-8f46-1d8199a8339c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5662f1e0ae684558a23f8f84c09eccb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:26Z,use_quota=True,user_id='265d74ee480c499faf3ecf60cc1cb094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(878cb6a6-4d37-4edb-8a30-73b8104605c6),volume_type_id=878cb6a6-4d37-4edb-8a30-73b8104605c6)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Creating volume 2459311d-70e5-4fdb-8f46-1d8199a8339c {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:56:26 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:56:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:26 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c 1073741824 Apr 24 19:56:26 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:27 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c 1073741824" returned: 0 in 1.003s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:27 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c Apr 24 19:56:27 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Acquiring lock "cinder-1502f44b-433f-4813-9e3f-58a1c16224fe-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Lock "cinder-1502f44b-433f-4813-9e3f-58a1c16224fe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Acquiring lock "cinder-quobyte-1502f44b-433f-4813-9e3f-58a1c16224fe" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Lock "cinder-quobyte-1502f44b-433f-4813-9e3f-58a1c16224fe" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9cf78a-0614-41d4-a509-6ca121dc6d3c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:27 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe Apr 24 19:56:27 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:27 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c" returned: 0 in 0.682s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260df371-aab8-4626-8f5e-b311c314f475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2459311d-70e5-4fdb-8f46-1d8199a8339c', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad92d75-6965-4ba2-91cb-57dc9402beb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:27 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Volume volume-2459311d-70e5-4fdb-8f46-1d8199a8339c (2459311d-70e5-4fdb-8f46-1d8199a8339c): created successfully Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad92d75-6965-4ba2-91cb-57dc9402beb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Flow 'volume_create_manager' (65be19b5-8e8f-4f54-ba6f-673c5e633be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:27 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d9bfd54a-7ad7-4e08-9c8d-83f337a61ea5 tempest-GroupSnapshotsTest-941597013 None] Created volume successfully. Apr 24 19:56:28 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe" returned: 0 in 0.731s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:28 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe Apr 24 19:56:28 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:28 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] GroupSnapshot 087d5d44-f2ff-4682-93d9-0c66d5ba1f9e: creating. Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Group snapshot 087d5d44-f2ff-4682-93d9-0c66d5ba1f9e: creating. {{(pid=81641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Creating offline snapshot e01963a4-eead-4060-bf17-e4b9ec3dd2c3 of volume 2459311d-70e5-4fdb-8f46-1d8199a8339c {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08e21d6-674e-4b5e-adc7-639d2eaf6074]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:28 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1502f44b-433f-4813-9e3f-58a1c16224fe" returned: 0 in 0.640s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Lock "cinder-quobyte-1502f44b-433f-4813-9e3f-58a1c16224fe" released by "delete_volume" :: held 1.421s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:28 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c Apr 24 19:56:28 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Created reservations ['5e2a8f3a-b874-4415-a333-07ff8e982063', 'af7fc278-907c-4598-a30e-6da33b813c3c', '98123d2e-2cb9-46d1-a4d2-c39822597b30', 'eed464fd-a080-4949-8f74-1dfeab3f8d95'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:29 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:56:29 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:29 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c" returned: 0 in 0.727s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:29 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 1G Apr 24 19:56:29 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:29 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.564s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:29 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:56:29 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Deleted volume successfully. Apr 24 19:56:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22541beb-a487-4558-bb37-6f7307325d8c tempest-VolumesNegativeTest-1042372005 None] Lock "cinder-1502f44b-433f-4813-9e3f-58a1c16224fe-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:30 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 1G" returned: 0 in 0.854s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2459311d-70e5-4fdb-8f46-1d8199a8339c -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:30 devstack sudo[87135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2459311d-70e5-4fdb-8f46-1d8199a8339c -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 Apr 24 19:56:30 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:31 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2459311d-70e5-4fdb-8f46-1d8199a8339c -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3" returned: 0 in 0.689s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:31 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:56:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:31 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 Apr 24 19:56:31 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:31 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3" returned: 0 in 0.589s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:31 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.info Apr 24 19:56:31 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:32 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.info" returned: 0 in 0.700s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:32 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:32 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.info Apr 24 19:56:32 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Flow 'volume_create_manager' (320e3bd3-85ac-467f-b8b6-e5f2a86269bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9574f79d-95e4-4570-ab44-db4c9168406f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9574f79d-95e4-4570-ab44-db4c9168406f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-459779495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224b0310-06a4-4a9f-85e1-acc30b23b7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8116b3e40d48410d811c4b8b0d09e40c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:33Z,use_quota=True,user_id='75a05f129f0748ebb51f0ecc8e9962c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61609c4-a95a-4cb4-bfac-d4d560b5f514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61609c4-a95a-4cb4-bfac-d4d560b5f514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fa8ecd-e87f-40e5-a216-4ad69cdf3503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fa8ecd-e87f-40e5-a216-4ad69cdf3503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224b0310-06a4-4a9f-85e1-acc30b23b7b9', 'volume_name': 'volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c715ccba-7c10-4994-8fef-6cb67249093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c715ccba-7c10-4994-8fef-6cb67249093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82eb93f1-0aa3-4b6a-b401-aa514691110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:32 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Volume 224b0310-06a4-4a9f-85e1-acc30b23b7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9', 'volume_size': 1} Apr 24 19:56:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:33 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.info" returned: 0 in 0.793s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.448s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-459779495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224b0310-06a4-4a9f-85e1-acc30b23b7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8116b3e40d48410d811c4b8b0d09e40c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:33Z,use_quota=True,user_id='75a05f129f0748ebb51f0ecc8e9962c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Creating volume 224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:56:33 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:56:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:33 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 1073741824 Apr 24 19:56:33 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:33 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e48b681d-a070-4b2c-abef-7e650d432830 tempest-GroupSnapshotsTest-941597013 None] group_snapshot 087d5d44-f2ff-4682-93d9-0c66d5ba1f9e: created successfully Apr 24 19:56:34 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 1073741824" returned: 0 in 0.850s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:34 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 Apr 24 19:56:34 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:34 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] group_snapshot 087d5d44-f2ff-4682-93d9-0c66d5ba1f9e: deleting Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] group_snapshot 087d5d44-f2ff-4682-93d9-0c66d5ba1f9e: deleting {{(pid=81641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-2459311d-70e5-4fdb-8f46-1d8199a8339c" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-2459311d-70e5-4fdb-8f46-1d8199a8339c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-e01963a4-eead-4060-bf17-e4b9ec3dd2c3" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-e01963a4-eead-4060-bf17-e4b9ec3dd2c3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Deleting offline snapshot e01963a4-eead-4060-bf17-e4b9ec3dd2c3 of volume 2459311d-70e5-4fdb-8f46-1d8199a8339c {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] snapshot_file for this snap is: volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b69731-5825-4a7b-bab1-4b18c28a2375]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:34 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 Apr 24 19:56:34 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:34 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9" returned: 0 in 0.788s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82eb93f1-0aa3-4b6a-b401-aa514691110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c083e64-c8e7-48d7-88a5-37ccad37bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:34 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Volume volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 (224b0310-06a4-4a9f-85e1-acc30b23b7b9): created successfully Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c083e64-c8e7-48d7-88a5-37ccad37bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Flow 'volume_create_manager' (320e3bd3-85ac-467f-b8b6-e5f2a86269bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:34 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4418206a-e52a-423a-b035-882865876b82 tempest-VolumesSnapshotListTestJSON-983148991 None] Created volume successfully. Apr 24 19:56:35 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3" returned: 0 in 0.780s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2459311d-70e5-4fdb-8f46-1d8199a8339c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:35 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5361082b-e6b5-4c2a-9708-23ba188d7fdd]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:35 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c Apr 24 19:56:35 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:35 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c" returned: 0 in 0.591s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:35 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 Apr 24 19:56:35 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Creating offline snapshot 3281661a-1c6e-44e3-9ab8-8c1166c89f7f of volume 224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:56:36 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb238101-3954-413d-aea4-d37da8b4f8b3]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:36 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 Apr 24 19:56:36 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:36 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3" returned: 0 in 0.882s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:36 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3 Apr 24 19:56:36 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:37 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9" returned: 0 in 0.932s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:37 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f 1G Apr 24 19:56:37 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Flow 'volume_create_manager' (18c873b1-793d-4382-af83-f1de5b4189c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea37065d-e0b2-4e04-81c6-4dbc666332d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea37065d-e0b2-4e04-81c6-4dbc666332d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2123304952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afba4412-3c13-45a2-bc41-ec51c141324e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d58eca35f94d4fb76f3d8db04cf685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:37Z,use_quota=True,user_id='360ab07df022425b98e747944f4baf71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bd1695-04e5-4535-9ca3-d23d6c8944e3),volume_type_id=29bd1695-04e5-4535-9ca3-d23d6c8944e3)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e794b0-d222-4a7c-84bc-40c984cdaf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e794b0-d222-4a7c-84bc-40c984cdaf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc77a41f-e412-4a5a-868a-89c0469e511f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc77a41f-e412-4a5a-868a-89c0469e511f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afba4412-3c13-45a2-bc41-ec51c141324e', 'volume_name': 'volume-afba4412-3c13-45a2-bc41-ec51c141324e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bb32d6-7f9b-44c7-9edc-fda7951b43ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bb32d6-7f9b-44c7-9edc-fda7951b43ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710b2153-f33e-4d72-a926-518d1868c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:37 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Volume afba4412-3c13-45a2-bc41-ec51c141324e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afba4412-3c13-45a2-bc41-ec51c141324e', 'volume_size': 1} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:37 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c.e01963a4-eead-4060-bf17-e4b9ec3dd2c3" returned: 0 in 0.586s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-e01963a4-eead-4060-bf17-e4b9ec3dd2c3" released by "_delete_snapshot" :: held 2.960s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-2459311d-70e5-4fdb-8f46-1d8199a8339c" released by "delete_snapshot" :: held 2.984s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:37 devstack cinder-volume[81641]: WARNING cinder.quota [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-414859191 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-414859191, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:56:37 devstack cinder-volume[81641]: WARNING cinder.quota [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-414859191 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-414859191, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] Created reservations ['46cbed2f-4d2e-4838-b221-1146011626f8', '187b98c8-9c25-4c05-a2d9-f6f0322686da', 'a37af1f1-4238-460d-a6d3-9c7a38697616', 'cbb21fce-39ca-48d5-b209-6aed9eca3b5b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:37 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-179f2b3a-4611-47d4-8d3a-54ed6961169f tempest-GroupSnapshotsTest-941597013 None] group_snapshot 087d5d44-f2ff-4682-93d9-0c66d5ba1f9e: deleted successfully Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "cinder-quobyte-2459311d-70e5-4fdb-8f46-1d8199a8339c" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-2459311d-70e5-4fdb-8f46-1d8199a8339c" acquired by "delete_volume" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e4c153-0fa8-4ba7-8c00-75c4313bb6a1]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:38 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f 1G" returned: 0 in 0.882s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:38 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c Apr 24 19:56:38 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:38 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f Apr 24 19:56:38 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:38 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c" returned: 0 in 0.627s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:38 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f" returned: 0 in 0.602s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:38 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f is being set with open permissions: ugo+rw Apr 24 19:56:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:38 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c Apr 24 19:56:38 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:38 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f Apr 24 19:56:38 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:39 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f" returned: 0 in 0.526s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:39 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2459311d-70e5-4fdb-8f46-1d8199a8339c" returned: 0 in 0.585s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:39 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.info Apr 24 19:56:39 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Lock "cinder-quobyte-2459311d-70e5-4fdb-8f46-1d8199a8339c" released by "delete_volume" :: held 1.307s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Created reservations ['6880a0a8-8c3f-498b-aa72-6fa1836de0a5'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:39 devstack cinder-volume[81641]: WARNING cinder.quota [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-414859191 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-414859191, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Created reservations ['62e07112-37be-412b-ac2b-11130bad11ae', '52b54d67-83ec-4d09-a94a-e96e9d3dcc37', '1ee43030-752b-4f44-a166-5d46eee33b81', '5eefb695-55e0-4bea-8d02-5cb7d28d0f71'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:39 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:56:39 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:39 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.info" returned: 0 in 0.485s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:39 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.info is being set with open permissions: ugo+rw Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:39 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.info Apr 24 19:56:39 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:39 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.479s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:39 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:56:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f6d04ff6-8f68-4dc9-b1d6-99db76c04594 tempest-GroupSnapshotsTest-941597013 None] Delete group completed successfully. Apr 24 19:56:40 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.info" returned: 0 in 0.471s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.999s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.858s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2123304952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afba4412-3c13-45a2-bc41-ec51c141324e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d58eca35f94d4fb76f3d8db04cf685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:37Z,use_quota=True,user_id='360ab07df022425b98e747944f4baf71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bd1695-04e5-4535-9ca3-d23d6c8944e3),volume_type_id=29bd1695-04e5-4535-9ca3-d23d6c8944e3)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Creating volume afba4412-3c13-45a2-bc41-ec51c141324e {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:56:40 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:40 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e 1073741824 Apr 24 19:56:40 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:40 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3d824de6-3f64-47f0-bc00-15687cf10eed tempest-VolumesSnapshotListTestJSON-983148991 None] Create snapshot completed successfully Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:40 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e 1073741824" returned: 0 in 0.777s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:40 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e Apr 24 19:56:40 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:41 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e" returned: 0 in 0.479s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.909s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Creating offline snapshot b38f1657-2dbd-45be-a393-b507d063e4eb of volume 224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710b2153-f33e-4d72-a926-518d1868c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afba4412-3c13-45a2-bc41-ec51c141324e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f117af-b971-495f-a397-160d4a866994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af6a8cc-acd3-475d-83db-13c6ad83f58e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:41 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Volume volume-afba4412-3c13-45a2-bc41-ec51c141324e (afba4412-3c13-45a2-bc41-ec51c141324e): created successfully Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f117af-b971-495f-a397-160d4a866994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Flow 'volume_create_manager' (18c873b1-793d-4382-af83-f1de5b4189c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:41 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d22f57f1-2338-47f4-945e-47282ab4cf11 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Created volume successfully. Apr 24 19:56:41 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f Apr 24 19:56:41 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:42 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f" returned: 0 in 0.705s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:42 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb 1G Apr 24 19:56:42 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a4477fd2-dc81-4a47-bb0b-c4cdff0f33cd tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a4477fd2-dc81-4a47-bb0b-c4cdff0f33cd tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a4477fd2-dc81-4a47-bb0b-c4cdff0f33cd tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a4477fd2-dc81-4a47-bb0b-c4cdff0f33cd tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a4477fd2-dc81-4a47-bb0b-c4cdff0f33cd tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a4477fd2-dc81-4a47-bb0b-c4cdff0f33cd tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:43 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:56:43 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:43 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb 1G" returned: 0 in 0.894s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:43 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb Apr 24 19:56:43 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:43 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a4477fd2-dc81-4a47-bb0b-c4cdff0f33cd tempest-VolumeRetypeWithoutMigrationTest-174472400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.642s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-a4477fd2-dc81-4a47-bb0b-c4cdff0f33cd tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:56:43 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a4477fd2-dc81-4a47-bb0b-c4cdff0f33cd tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Retype volume completed successfully. Apr 24 19:56:43 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb" returned: 0 in 0.686s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:43 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb is being set with open permissions: ugo+rw Apr 24 19:56:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:43 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb Apr 24 19:56:43 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Acquiring lock "cinder-afba4412-3c13-45a2-bc41-ec51c141324e-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "cinder-afba4412-3c13-45a2-bc41-ec51c141324e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Acquiring lock "cinder-quobyte-afba4412-3c13-45a2-bc41-ec51c141324e" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "cinder-quobyte-afba4412-3c13-45a2-bc41-ec51c141324e" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9830ea-1275-4245-9fb2-961158c16874]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:44 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb" returned: 0 in 0.744s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.140s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:44 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-0de451fa-adaf-4caf-8e94-518255d27ad8 tempest-VolumesSnapshotListTestJSON-983148991 None] Create snapshot completed successfully Apr 24 19:56:44 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e Apr 24 19:56:44 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Creating offline snapshot b494eb90-9f47-4517-84b8-5f0da653a319 of volume 224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:56:45 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1fcf38-e6fd-402c-9ee3-44d462b364a3]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:45 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb Apr 24 19:56:45 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:45 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e" returned: 0 in 0.876s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:45 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e Apr 24 19:56:45 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:45 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-071f8ac2-b217-41dc-aa44-9522a0943dfd tempest-GroupSnapshotsV319Test-1624455525 None] Group tempest-GroupSnapshotsV319Test-Group-2003010243: creating Apr 24 19:56:45 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-071f8ac2-b217-41dc-aa44-9522a0943dfd tempest-GroupSnapshotsV319Test-1624455525 None] Group tempest-GroupSnapshotsV319Test-Group-2003010243: created successfully Apr 24 19:56:45 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-071f8ac2-b217-41dc-aa44-9522a0943dfd tempest-GroupSnapshotsV319Test-1624455525 None] Create group completed successfully. Apr 24 19:56:45 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb" returned: 0 in 0.824s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:45 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 1G Apr 24 19:56:45 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:46 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-afba4412-3c13-45a2-bc41-ec51c141324e" returned: 0 in 0.704s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "cinder-quobyte-afba4412-3c13-45a2-bc41-ec51c141324e" released by "delete_volume" :: held 1.630s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:46 devstack cinder-volume[81641]: WARNING cinder.quota [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:56:46 devstack cinder-volume[81641]: WARNING cinder.quota [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Created reservations ['eafa917d-6126-407b-940f-aa5c21ddd0eb', '3d36a366-f4a0-4e2c-93df-0a562129f37c', 'df9739c9-3f8c-42ba-96a5-a2dbd6e9a347', '67dd67c9-2a67-4175-abf1-c7c217103a78'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:46 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:56:46 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:46 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 1G" returned: 0 in 0.805s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:46 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 Apr 24 19:56:46 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:46 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.587s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:56:46 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Deleted volume successfully. Apr 24 19:56:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-15c30abc-e4b7-48f5-a580-bfde8c93a6d4 tempest-VolumeRetypeWithoutMigrationTest-174472400 None] Lock "cinder-afba4412-3c13-45a2-bc41-ec51c141324e-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Flow 'volume_create_manager' (e82cdecc-63eb-460b-8afb-2e421f831c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9badc011-5b98-420f-b3f2-2dbdf09c8de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9badc011-5b98-420f-b3f2-2dbdf09c8de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1578966107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f8f9270-d48a-4c3a-9784-b7d0c49a6724,host='devstack@QuobyteHD#QuobyteHD',id=360723e4-0961-4332-afb1-fe3077cb9d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b712a376419e4a8abddfee2b1ab3d125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:47Z,use_quota=True,user_id='3ff735c5a3b2408a8444fbaa4e22a6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(568d5420-6128-403f-a670-8cf911127230),volume_type_id=568d5420-6128-403f-a670-8cf911127230)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14633430-37c9-46d0-a771-e07cabbc8a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14633430-37c9-46d0-a771-e07cabbc8a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29e0d44-0461-4298-95b7-4a7cdb7255b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29e0d44-0461-4298-95b7-4a7cdb7255b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360723e4-0961-4332-afb1-fe3077cb9d54', 'volume_name': 'volume-360723e4-0961-4332-afb1-fe3077cb9d54', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34728337-da54-41ad-b2c6-5e345181961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34728337-da54-41ad-b2c6-5e345181961a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3881a8c0-f623-4266-be38-f037abd949fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:47 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Volume 360723e4-0961-4332-afb1-fe3077cb9d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360723e4-0961-4332-afb1-fe3077cb9d54', 'volume_size': 1} Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:47 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319" returned: 0 in 0.801s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:47 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 is being set with open permissions: ugo+rw Apr 24 19:56:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:47 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 Apr 24 19:56:47 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:48 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319" returned: 0 in 0.557s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f8f9270-d48a-4c3a-9784-b7d0c49a6724,created_at=2026-04-24T17:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1578966107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f8f9270-d48a-4c3a-9784-b7d0c49a6724,host='devstack@QuobyteHD#QuobyteHD',id=360723e4-0961-4332-afb1-fe3077cb9d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b712a376419e4a8abddfee2b1ab3d125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:47Z,use_quota=True,user_id='3ff735c5a3b2408a8444fbaa4e22a6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(568d5420-6128-403f-a670-8cf911127230),volume_type_id=568d5420-6128-403f-a670-8cf911127230)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Creating volume 360723e4-0961-4332-afb1-fe3077cb9d54 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:56:48 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:48 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 1073741824 Apr 24 19:56:48 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:48 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f89ae29a-fdb4-47c4-acbb-bc51aadbdf39 tempest-VolumesSnapshotListTestJSON-983148991 None] Create snapshot completed successfully Apr 24 19:56:48 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 1073741824" returned: 0 in 0.746s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:48 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 Apr 24 19:56:48 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:49 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54" returned: 0 in 0.635s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:56:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3881a8c0-f623-4266-be38-f037abd949fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360723e4-0961-4332-afb1-fe3077cb9d54', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce30e87-6096-4cf1-8b0d-c91ae4f6393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:49 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Volume volume-360723e4-0961-4332-afb1-fe3077cb9d54 (360723e4-0961-4332-afb1-fe3077cb9d54): created successfully Apr 24 19:56:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce30e87-6096-4cf1-8b0d-c91ae4f6393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Flow 'volume_create_manager' (e82cdecc-63eb-460b-8afb-2e421f831c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:49 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b3b03e6f-2d59-461b-afc8-aef1962b4d76 tempest-GroupSnapshotsV319Test-1624455525 None] Created volume successfully. Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-b494eb90-9f47-4517-84b8-5f0da653a319-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-b494eb90-9f47-4517-84b8-5f0da653a319-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-quobyte-b494eb90-9f47-4517-84b8-5f0da653a319" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-b494eb90-9f47-4517-84b8-5f0da653a319" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Deleting offline snapshot b494eb90-9f47-4517-84b8-5f0da653a319 of volume 224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] snapshot_file for this snap is: volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79b5703-f6c3-4de1-923e-c8f461d269a4]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:50 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 Apr 24 19:56:50 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:50 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319" returned: 0 in 0.664s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6574b865-0d80-4bd9-b361-f4e4f1a02d83]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:51 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb Apr 24 19:56:51 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:51 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] GroupSnapshot 6a2628e8-9fd2-44a6-bf5e-f8fc9b7d6c6d: creating. Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:UPDATE=123,cinder:DELETE=7,cinder:SELECT=129,cinder:INSERT=31 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Group snapshot 6a2628e8-9fd2-44a6-bf5e-f8fc9b7d6c6d: creating. {{(pid=81641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Creating offline snapshot 99a2e9be-55ee-4a02-915c-5341e3d5f7e9 of volume 360723e4-0961-4332-afb1-fe3077cb9d54 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e5a8e-649a-4cf4-9a28-44a704f425ba]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:51 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 Apr 24 19:56:51 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:51 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb" returned: 0 in 0.746s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:51 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 Apr 24 19:56:51 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:51 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54" returned: 0 in 0.675s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:51 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 1G Apr 24 19:56:51 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:52 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319" returned: 0 in 0.816s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:52 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319 Apr 24 19:56:52 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:52 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 1G" returned: 0 in 0.737s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360723e4-0961-4332-afb1-fe3077cb9d54 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:52 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360723e4-0961-4332-afb1-fe3077cb9d54 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 Apr 24 19:56:52 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:53 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:56:53 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:53 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b494eb90-9f47-4517-84b8-5f0da653a319" returned: 0 in 0.650s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-b494eb90-9f47-4517-84b8-5f0da653a319" released by "_delete_snapshot" :: held 3.123s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" released by "delete_snapshot" :: held 3.162s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:UPDATE=139,cinder:SELECT=137,cinder:DELETE=9,cinder:INSERT=28 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:56:53 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360723e4-0961-4332-afb1-fe3077cb9d54 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9" returned: 0 in 0.693s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:53 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:53 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 Apr 24 19:56:53 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Created reservations ['8617f2b4-e5fe-47c7-b695-1502ec91bdeb', '2e6bd28c-38c1-420b-90ef-2392a2616e54', '2b0b3761-69d6-436e-9fe9-7668323afbed', '514b3aa6-1dc3-4f63-bbe7-4d243e7137ff'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:53 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Delete snapshot completed successfully. Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-4faea32a-9824-4c09-b474-7d1917b0993e tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-b494eb90-9f47-4517-84b8-5f0da653a319-delete_snapshot" released by "delete_snapshot" :: held 3.614s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:53 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.859s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:56:54 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9" returned: 0 in 1.067s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-b38f1657-2dbd-45be-a393-b507d063e4eb-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:54 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.info Apr 24 19:56:54 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-b38f1657-2dbd-45be-a393-b507d063e4eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" acquired by "delete_snapshot" :: waited 0.052s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-quobyte-b38f1657-2dbd-45be-a393-b507d063e4eb" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-b38f1657-2dbd-45be-a393-b507d063e4eb" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Deleting offline snapshot b38f1657-2dbd-45be-a393-b507d063e4eb of volume 224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] snapshot_file for this snap is: volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57198e6-ab0a-407b-bf6a-e82dc05b0a21]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:54 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb Apr 24 19:56:54 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:55 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.info" returned: 0 in 0.694s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:55 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:56:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:55 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.info Apr 24 19:56:55 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:56 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.info" returned: 0 in 0.943s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.955s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:56 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb" returned: 0 in 1.431s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:56 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[60edaafe-969a-454f-b605-73e57e21a649]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1acf013f-ff1b-4b51-b7e0-6a095199f960 tempest-GroupSnapshotsV319Test-1624455525 None] group_snapshot 6a2628e8-9fd2-44a6-bf5e-f8fc9b7d6c6d: created successfully Apr 24 19:56:56 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f Apr 24 19:56:56 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:57 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f" returned: 0 in 0.869s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:57 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb Apr 24 19:56:57 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:57 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] group_snapshot 6a2628e8-9fd2-44a6-bf5e-f8fc9b7d6c6d: deleting Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] group_snapshot 6a2628e8-9fd2-44a6-bf5e-f8fc9b7d6c6d: deleting {{(pid=81641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Acquiring lock "cinder-quobyte-360723e4-0961-4332-afb1-fe3077cb9d54" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "cinder-quobyte-360723e4-0961-4332-afb1-fe3077cb9d54" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Acquiring lock "cinder-quobyte-99a2e9be-55ee-4a02-915c-5341e3d5f7e9" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "cinder-quobyte-99a2e9be-55ee-4a02-915c-5341e3d5f7e9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Deleting offline snapshot 99a2e9be-55ee-4a02-915c-5341e3d5f7e9 of volume 360723e4-0961-4332-afb1-fe3077cb9d54 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] snapshot_file for this snap is: volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1fe306-6dab-46d1-a071-a91c79bedcc1]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:57 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 Apr 24 19:56:57 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (dca70c9c-2843-49d4-a07e-cefee6a56c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf2d1fd-dff7-453f-a2cc-982eb75db758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf2d1fd-dff7-453f-a2cc-982eb75db758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-557825131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5bbe930-4749-4e65-98a6-94ce23ef876e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:58Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57824161-f859-4e22-acdb-026584f1dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57824161-f859-4e22-acdb-026584f1dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2096ec6-0c33-43ca-a360-f50d4d9f22c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2096ec6-0c33-43ca-a360-f50d4d9f22c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5bbe930-4749-4e65-98a6-94ce23ef876e', 'volume_name': 'volume-a5bbe930-4749-4e65-98a6-94ce23ef876e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9710df-dbf2-4541-afc0-99d4847cd284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9710df-dbf2-4541-afc0-99d4847cd284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179068d5-6bbd-4a14-abd0-2c58e41a93cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:58 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Volume a5bbe930-4749-4e65-98a6-94ce23ef876e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5bbe930-4749-4e65-98a6-94ce23ef876e', 'volume_size': 1} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-557825131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5bbe930-4749-4e65-98a6-94ce23ef876e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:56:58Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Creating volume a5bbe930-4749-4e65-98a6-94ce23ef876e {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:56:58 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:58 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e 1073741824 Apr 24 19:56:58 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:58 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb" returned: 0 in 1.307s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:58 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9" returned: 0 in 0.867s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-360723e4-0961-4332-afb1-fe3077cb9d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e818d81-cef9-4fb9-8375-ef2cb1c42f1c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:56:58 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb Apr 24 19:56:58 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:58 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 Apr 24 19:56:58 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:59 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e 1073741824" returned: 0 in 0.917s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:59 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e Apr 24 19:56:59 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:59 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.b38f1657-2dbd-45be-a393-b507d063e4eb" returned: 0 in 1.055s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:59 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54" returned: 0 in 1.039s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-b38f1657-2dbd-45be-a393-b507d063e4eb" released by "_delete_snapshot" :: held 4.850s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" released by "delete_snapshot" :: held 4.910s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:59 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 Apr 24 19:56:59 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Created reservations ['e89eb4c4-04d1-43f2-a873-1cf75af78502', 'c1c5163f-1f43-4e77-b36d-aab3d666cd25', 'c7add32d-302b-4a72-9312-d06af2e6120b', 'd55565e7-851e-4dff-9232-74c057bdb12b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:56:59 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Delete snapshot completed successfully. Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cc9368a1-a75b-4163-9ed2-1012bfe0fe4c tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-b38f1657-2dbd-45be-a393-b507d063e4eb-delete_snapshot" released by "delete_snapshot" :: held 5.153s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:56:59 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e" returned: 0 in 0.673s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179068d5-6bbd-4a14-abd0-2c58e41a93cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5bbe930-4749-4e65-98a6-94ce23ef876e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bea584f-756a-4978-bcd9-83a166f177da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:56:59 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Volume volume-a5bbe930-4749-4e65-98a6-94ce23ef876e (a5bbe930-4749-4e65-98a6-94ce23ef876e): created successfully Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bea584f-756a-4978-bcd9-83a166f177da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (dca70c9c-2843-49d4-a07e-cefee6a56c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:56:59 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3f33c0c2-5c5a-4212-a0cc-004a8c2a8271 tempest-VolumesActionsTest-1827524784 None] Created volume successfully. Apr 24 19:56:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-3281661a-1c6e-44e3-9ab8-8c1166c89f7f-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-3281661a-1c6e-44e3-9ab8-8c1166c89f7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-quobyte-3281661a-1c6e-44e3-9ab8-8c1166c89f7f" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-3281661a-1c6e-44e3-9ab8-8c1166c89f7f" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Deleting offline snapshot 3281661a-1c6e-44e3-9ab8-8c1166c89f7f of volume 224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] snapshot_file for this snap is: volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[feda3485-9474-4996-beec-9143d9e980ed]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:00 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f Apr 24 19:57:00 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3bc9a7c9-80e3-41f5-a24a-f3556eebc6a1 tempest-VolumesActionsTest-1827524784 None] Acquiring lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e" by "attach_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3bc9a7c9-80e3-41f5-a24a-f3556eebc6a1 tempest-VolumesActionsTest-1827524784 None] Lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e" acquired by "attach_volume" :: waited 0.036s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Flow 'volume_create_manager' (3e22f89e-c45a-4c70-951f-6909951b54a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f942ff-60f5-46d8-b622-ea91ef3d57f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f942ff-60f5-46d8-b622-ea91ef3d57f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-661918936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a5bb6e-8401-4ff7-af4f-ed47df198471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bcaa7b5aae2499e9f0fe32b6a9bf49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:00Z,use_quota=True,user_id='5c01a2a460f641b49e1d53b48588524e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ead6aa8c-b0cc-41e3-b2e9-696c74941e7b),volume_type_id=ead6aa8c-b0cc-41e3-b2e9-696c74941e7b)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93a1d16-3dcf-402c-aaf8-5b84066426f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93a1d16-3dcf-402c-aaf8-5b84066426f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d092309-9fb9-4ceb-8623-d7869851a6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d092309-9fb9-4ceb-8623-d7869851a6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a5bb6e-8401-4ff7-af4f-ed47df198471', 'volume_name': 'volume-83a5bb6e-8401-4ff7-af4f-ed47df198471', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147ceb53-f676-4626-9ddb-32a2a0cc7910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147ceb53-f676-4626-9ddb-32a2a0cc7910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689d9bf3-df27-4dff-a9e3-d91fc65b19b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:00 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Volume 83a5bb6e-8401-4ff7-af4f-ed47df198471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a5bb6e-8401-4ff7-af4f-ed47df198471', 'volume_size': 1} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-661918936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a5bb6e-8401-4ff7-af4f-ed47df198471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bcaa7b5aae2499e9f0fe32b6a9bf49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:00Z,use_quota=True,user_id='5c01a2a460f641b49e1d53b48588524e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ead6aa8c-b0cc-41e3-b2e9-696c74941e7b),volume_type_id=ead6aa8c-b0cc-41e3-b2e9-696c74941e7b)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Creating volume 83a5bb6e-8401-4ff7-af4f-ed47df198471 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:00 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:00 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3bc9a7c9-80e3-41f5-a24a-f3556eebc6a1 tempest-VolumesActionsTest-1827524784 None] Attaching volume a5bbe930-4749-4e65-98a6-94ce23ef876e to instance 5baf2cf5-5b83-4081-98eb-9c5a86f2832a at mountpoint /dev/vdb on host None. Apr 24 19:57:00 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 1073741824 Apr 24 19:57:00 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:00 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3bc9a7c9-80e3-41f5-a24a-f3556eebc6a1 tempest-VolumesActionsTest-1827524784 None] Attach volume completed successfully. Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3bc9a7c9-80e3-41f5-a24a-f3556eebc6a1 tempest-VolumesActionsTest-1827524784 None] Lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e" released by "attach_volume" :: held 0.307s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:00 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9" returned: 0 in 1.205s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:00 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9 Apr 24 19:57:00 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:00 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f" returned: 0 in 0.703s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd24e38-2a22-4a87-96cf-2282e64a9b02]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:01 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 Apr 24 19:57:01 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:01 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54.99a2e9be-55ee-4a02-915c-5341e3d5f7e9" returned: 0 in 0.835s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "cinder-quobyte-99a2e9be-55ee-4a02-915c-5341e3d5f7e9" released by "_delete_snapshot" :: held 4.148s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "cinder-quobyte-360723e4-0961-4332-afb1-fe3077cb9d54" released by "delete_snapshot" :: held 4.187s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3610dae1-dbcd-4899-a8ab-d902ec8a9eeb tempest-VolumesActionsTest-537856109 None] Terminate volume connection completed successfully. Apr 24 19:57:01 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 1073741824" returned: 0 in 1.068s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:01 devstack cinder-volume[81641]: WARNING cinder.quota [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1870757519 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1870757519, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:57:01 devstack cinder-volume[81641]: WARNING cinder.quota [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1870757519 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1870757519, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:57:01 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 Apr 24 19:57:01 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:01 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9" returned: 0 in 0.829s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:01 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] Created reservations ['e12fb4b9-9c93-4a2a-b5da-b072df9373f6', '752e837d-cd9b-44e7-9d83-1a60c803c348', 'c3ad1a8c-0c14-4721-989f-5f3a0da89d0f', 'c4d8a7a6-b1a0-4ba9-bec8-92b99273b9d6'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:01 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f Apr 24 19:57:01 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-75b0f9cc-3cb7-4968-96a9-2271f8379d22 tempest-GroupSnapshotsV319Test-1624455525 None] group_snapshot 6a2628e8-9fd2-44a6-bf5e-f8fc9b7d6c6d: deleted successfully Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3610dae1-dbcd-4899-a8ab-d902ec8a9eeb tempest-VolumesActionsTest-537856109 None] Acquiring lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e-detach_volume" by "detach_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3610dae1-dbcd-4899-a8ab-d902ec8a9eeb tempest-VolumesActionsTest-537856109 None] Lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3610dae1-dbcd-4899-a8ab-d902ec8a9eeb tempest-VolumesActionsTest-537856109 None] Detaching volume a5bbe930-4749-4e65-98a6-94ce23ef876e from instance 5baf2cf5-5b83-4081-98eb-9c5a86f2832a. Apr 24 19:57:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3610dae1-dbcd-4899-a8ab-d902ec8a9eeb tempest-VolumesActionsTest-537856109 None] Detach volume completed successfully. Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3610dae1-dbcd-4899-a8ab-d902ec8a9eeb tempest-VolumesActionsTest-537856109 None] Lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:02 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471" returned: 0 in 0.561s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689d9bf3-df27-4dff-a9e3-d91fc65b19b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a5bb6e-8401-4ff7-af4f-ed47df198471', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58397b1b-c14a-4de3-be2d-1501432ba2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:02 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Volume volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 (83a5bb6e-8401-4ff7-af4f-ed47df198471): created successfully Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58397b1b-c14a-4de3-be2d-1501432ba2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Flow 'volume_create_manager' (3e22f89e-c45a-4c70-951f-6909951b54a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-edc3b278-1c33-4c0e-a5d0-996eefb50322 tempest-VolumeTypesAccessTest-839058350 None] Created volume successfully. Apr 24 19:57:02 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f" returned: 0 in 0.795s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Acquiring lock "cinder-quobyte-360723e4-0961-4332-afb1-fe3077cb9d54" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "cinder-quobyte-360723e4-0961-4332-afb1-fe3077cb9d54" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:02 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f Apr 24 19:57:02 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[655dc804-5748-4a97-99a1-8b0411fc20e4]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Acquiring lock "cinder-83a5bb6e-8401-4ff7-af4f-ed47df198471-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Lock "cinder-83a5bb6e-8401-4ff7-af4f-ed47df198471-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Acquiring lock "cinder-quobyte-83a5bb6e-8401-4ff7-af4f-ed47df198471" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Lock "cinder-quobyte-83a5bb6e-8401-4ff7-af4f-ed47df198471" acquired by "delete_volume" :: waited 0.043s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aad450-48e8-4de0-97c7-5ebd02501aa6]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:02 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 Apr 24 19:57:02 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7bd1ebb5-97a6-491a-b22c-c33fa559d061 tempest-VolumesActionsTest-1827524784 None] Acquiring lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e-detach_volume" by "detach_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7bd1ebb5-97a6-491a-b22c-c33fa559d061 tempest-VolumesActionsTest-1827524784 None] Lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7bd1ebb5-97a6-491a-b22c-c33fa559d061 tempest-VolumesActionsTest-1827524784 None] Volume detach called, but volume not attached. Apr 24 19:57:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7bd1ebb5-97a6-491a-b22c-c33fa559d061 tempest-VolumesActionsTest-1827524784 None] Lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:02 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 Apr 24 19:57:02 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:03 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9.3281661a-1c6e-44e3-9ab8-8c1166c89f7f" returned: 0 in 0.802s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-3281661a-1c6e-44e3-9ab8-8c1166c89f7f" released by "_delete_snapshot" :: held 3.301s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" released by "delete_snapshot" :: held 3.364s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:03 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54" returned: 0 in 0.843s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:03 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471" returned: 0 in 0.653s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:03 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54 Apr 24 19:57:03 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:03 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471 Apr 24 19:57:03 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Created reservations ['a0d37ddb-3c62-4af2-8b29-79a31bac2e7e', '8eab7676-0c00-49a8-91a6-a7dc84e9bf86', 'd86f379d-595d-4d59-a9d5-a2748c053d80', '09f49c0b-f2ab-4cd0-9969-f037a7ca1656'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Acquiring lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:03 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Delete snapshot completed successfully. Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fc66a418-e44f-4109-8549-7b1423882bdd tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-3281661a-1c6e-44e3-9ab8-8c1166c89f7f-delete_snapshot" released by "delete_snapshot" :: held 3.700s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Acquiring lock "cinder-quobyte-a5bbe930-4749-4e65-98a6-94ce23ef876e" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Lock "cinder-quobyte-a5bbe930-4749-4e65-98a6-94ce23ef876e" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ce6a28-aeaa-4273-b737-a870ef2f6f7f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:03 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e Apr 24 19:57:03 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:04 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-360723e4-0961-4332-afb1-fe3077cb9d54" returned: 0 in 0.617s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "cinder-quobyte-360723e4-0961-4332-afb1-fe3077cb9d54" released by "delete_volume" :: held 1.533s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Created reservations ['869d364b-e847-41ef-b97a-f36274d280c5'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:04 devstack cinder-volume[81641]: WARNING cinder.quota [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1870757519 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1870757519, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:57:04 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Created reservations ['75418944-c80c-44ac-bcfe-ee2528beda36', '08024fe7-9c7e-44bc-ad9f-3cb2c3fd5351', 'dccca03f-986d-4880-b53f-506a743613d8', '44b62619-0d0d-461a-9e17-d89ff5e7b67d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-83a5bb6e-8401-4ff7-af4f-ed47df198471" returned: 0 in 0.806s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Lock "cinder-quobyte-83a5bb6e-8401-4ff7-af4f-ed47df198471" released by "delete_volume" :: held 1.551s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-224b0310-06a4-4a9f-85e1-acc30b23b7b9-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:04 devstack cinder-volume[81641]: WARNING cinder.quota [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-233168196 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-233168196, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:57:04 devstack cinder-volume[81641]: WARNING cinder.quota [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-233168196 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-233168196, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-224b0310-06a4-4a9f-85e1-acc30b23b7b9-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Created reservations ['a3f7bc3d-2fe9-4f54-b3a1-a4bf6e590455', '95c82c1a-7ec7-411f-bdaf-3ccdd7e93a24', '9ceb822b-e2c3-4695-bb5f-664325dac4c6', '6a2be53d-f1ee-43c5-83af-3c6b26347ae5'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:04 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e" returned: 0 in 0.734s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:04 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:04 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:04 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e Apr 24 19:57:04 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" acquired by "delete_volume" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:04 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:04 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac0e875-c443-4e65-b4d6-cae77ceb1f6d]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:04 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 Apr 24 19:57:04 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:05 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.996s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:05 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:05 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Deleted volume successfully. Apr 24 19:57:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ebdd9ca-68e5-4c33-9f6c-29e782e790f6 tempest-VolumeTypesAccessTest-839058350 None] Lock "cinder-83a5bb6e-8401-4ff7-af4f-ed47df198471-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:06 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.383s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:06 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2fc16c3d-3dcc-4222-af0c-9cbdbbd45f02 tempest-GroupSnapshotsV319Test-1624455525 None] Delete group completed successfully. Apr 24 19:57:06 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a5bbe930-4749-4e65-98a6-94ce23ef876e" returned: 0 in 1.460s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Lock "cinder-quobyte-a5bbe930-4749-4e65-98a6-94ce23ef876e" released by "delete_volume" :: held 2.296s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:06 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9" returned: 0 in 1.414s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Created reservations ['4ff995ab-29b2-4ec1-b7e5-43824f24e263', '08e8cbe6-5ace-4ed0-9c75-b822e990b7b1', 'd1d2a51d-0f10-4f3d-98f2-b088af349556', '6972266c-cd0d-451e-aefd-4a350fb32c44'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:06 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9 Apr 24 19:57:06 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:06 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:06 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:06 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-224b0310-06a4-4a9f-85e1-acc30b23b7b9" returned: 0 in 0.705s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-quobyte-224b0310-06a4-4a9f-85e1-acc30b23b7b9" released by "delete_volume" :: held 2.185s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Created reservations ['6ae4dc01-d203-42fd-8057-c1a2f7089ab2', '04340134-fb49-4aa4-9e5d-ec7132ebf468', '0da0fd01-cfeb-43bb-a12a-77414866f59e', 'abeae3a0-03e4-4def-9c80-ff31010cccca'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:07 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:07 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:07 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.784s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:07 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:07 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Deleted volume successfully. Apr 24 19:57:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-056fde36-6310-4ad0-8a6b-165a0150870c tempest-VolumesActionsTest-1827524784 None] Lock "cinder-a5bbe930-4749-4e65-98a6-94ce23ef876e-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:07 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.559s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:07 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:07 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Deleted volume successfully. Apr 24 19:57:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-90962fee-1386-49e5-9524-a28f06302139 tempest-VolumesSnapshotListTestJSON-983148991 None] Lock "cinder-224b0310-06a4-4a9f-85e1-acc30b23b7b9-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (8af47958-9dd6-4d92-a490-f4aec837c182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeb2973-34a7-496e-aa90-6f628fa5897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeb2973-34a7-496e-aa90-6f628fa5897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961719005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0921bddb-e005-4a43-9522-b20dcb325e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:12Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594d3d7f-4f42-4442-a8bc-b96efc574f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594d3d7f-4f42-4442-a8bc-b96efc574f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57080cf-c86b-46c4-aee7-43d477959361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57080cf-c86b-46c4-aee7-43d477959361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0921bddb-e005-4a43-9522-b20dcb325e33', 'volume_name': 'volume-0921bddb-e005-4a43-9522-b20dcb325e33', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15614fd-f649-4a9a-9c8b-02eb8f12fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15614fd-f649-4a9a-9c8b-02eb8f12fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5e158a-f83c-45a5-88df-b927394c3d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:12 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume 0921bddb-e005-4a43-9522-b20dcb325e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0921bddb-e005-4a43-9522-b20dcb325e33', 'volume_size': 1} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961719005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0921bddb-e005-4a43-9522-b20dcb325e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:12Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Creating volume 0921bddb-e005-4a43-9522-b20dcb325e33 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:12 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:12 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33 1073741824 Apr 24 19:57:12 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:13 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33 1073741824" returned: 0 in 0.751s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:13 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33 Apr 24 19:57:13 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:13 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33" returned: 0 in 0.589s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5e158a-f83c-45a5-88df-b927394c3d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0921bddb-e005-4a43-9522-b20dcb325e33', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97614a64-c5cd-4188-ba58-34ac11d450ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:13 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume volume-0921bddb-e005-4a43-9522-b20dcb325e33 (0921bddb-e005-4a43-9522-b20dcb325e33): created successfully Apr 24 19:57:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97614a64-c5cd-4188-ba58-34ac11d450ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (8af47958-9dd6-4d92-a490-f4aec837c182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:13 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4efe538e-e659-473c-8da5-3d0761943a33 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created volume successfully. Apr 24 19:57:14 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (5ad6b135-5038-4f7b-9da3-bd4266344095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb5e72d-ce94-4b97-8a30-6fe11627a177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb5e72d-ce94-4b97-8a30-6fe11627a177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468769818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1dd5b1e-19a0-49a0-b492-b6af35bffda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:15Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1917c2f-80ad-4377-a303-a78575da62e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1917c2f-80ad-4377-a303-a78575da62e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26479bae-9b5b-4d03-902a-b7c7b798474e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26479bae-9b5b-4d03-902a-b7c7b798474e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1dd5b1e-19a0-49a0-b492-b6af35bffda9', 'volume_name': 'volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dab2f84-38d5-4564-879e-4d97df0e6598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dab2f84-38d5-4564-879e-4d97df0e6598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e48c16-0ba7-4b41-9bf9-18805baafb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume f1dd5b1e-19a0-49a0-b492-b6af35bffda9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9', 'volume_size': 1} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468769818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1dd5b1e-19a0-49a0-b492-b6af35bffda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:15Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Creating volume f1dd5b1e-19a0-49a0-b492-b6af35bffda9 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:15 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:15 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 1073741824 Apr 24 19:57:15 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (89e1bc1a-216e-4141-b926-976008375c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1ce349-60dc-492f-a1ad-b2d5ccf34741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1ce349-60dc-492f-a1ad-b2d5ccf34741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-192116177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34f4450-abe0-431e-aa6b-9a6d55cdb03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:15Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdc7cb6-a72a-4a85-8f30-91a45dbf3131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdc7cb6-a72a-4a85-8f30-91a45dbf3131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82343453-2331-4255-9111-4b1cb1a8acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82343453-2331-4255-9111-4b1cb1a8acdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34f4450-abe0-431e-aa6b-9a6d55cdb03b', 'volume_name': 'volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b9bb07-079a-493e-a7e8-0fb775f96b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b9bb07-079a-493e-a7e8-0fb775f96b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0c31df-d247-425a-932a-b3d6df5d515e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume f34f4450-abe0-431e-aa6b-9a6d55cdb03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b', 'volume_size': 1} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (f1b529ea-f66f-49a1-aef4-f33d474c3df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7f69c7-29a1-4fd9-b740-6fd2edc5d885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7f69c7-29a1-4fd9-b740-6fd2edc5d885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1210471404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574fbbcd-187c-4178-947e-13cbd64eaede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:15Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c6c177-a894-4189-8ca4-b23696b93580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c6c177-a894-4189-8ca4-b23696b93580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec21375e-bc8c-4525-9828-55f805dfe199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec21375e-bc8c-4525-9828-55f805dfe199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574fbbcd-187c-4178-947e-13cbd64eaede', 'volume_name': 'volume-574fbbcd-187c-4178-947e-13cbd64eaede', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1c7a29-0ae1-4aca-a690-12a0686aa884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1c7a29-0ae1-4aca-a690-12a0686aa884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94977628-892f-484d-ba1b-34054d0cf138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Volume 574fbbcd-187c-4178-947e-13cbd64eaede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574fbbcd-187c-4178-947e-13cbd64eaede', 'volume_size': 1} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (448ffee0-5468-4277-ac15-a38d39d51b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3646f3-7bb8-451a-86c4-f261cb912abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3646f3-7bb8-451a-86c4-f261cb912abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1192163292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e06a08-cc06-40e7-aeb4-2de1ed4ef472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:16Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af6d701-577c-485a-aebe-10dd118ae3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af6d701-577c-485a-aebe-10dd118ae3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad403a7-8a40-4071-80b0-6480f29ca87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad403a7-8a40-4071-80b0-6480f29ca87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e06a08-cc06-40e7-aeb4-2de1ed4ef472', 'volume_name': 'volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af233fdf-0ba2-434c-b63e-2b5a551800de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af233fdf-0ba2-434c-b63e-2b5a551800de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd96baca-5dcc-4359-a50f-300a6d4ff72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:15 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume 56e06a08-cc06-40e7-aeb4-2de1ed4ef472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472', 'volume_size': 1} Apr 24 19:57:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:16 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 1073741824" returned: 0 in 0.969s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:16 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 Apr 24 19:57:16 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (9f282cd9-a4f3-43c3-9fd5-f06b530fb942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455c93de-5966-4d15-acd9-f41df3307aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455c93de-5966-4d15-acd9-f41df3307aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085570889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c19a10-bdea-405e-ac54-80081272aad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:16Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10ab4a5-a79a-471d-ae30-31a194a8fd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10ab4a5-a79a-471d-ae30-31a194a8fd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c23e37-0153-4eec-86c6-0a7db8be087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c23e37-0153-4eec-86c6-0a7db8be087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c19a10-bdea-405e-ac54-80081272aad0', 'volume_name': 'volume-85c19a10-bdea-405e-ac54-80081272aad0', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be5e858-52e0-4a3e-be42-732e4fa4c574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be5e858-52e0-4a3e-be42-732e4fa4c574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d250cc45-a1cb-43bb-98ad-8503e38ddc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume 85c19a10-bdea-405e-ac54-80081272aad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c19a10-bdea-405e-ac54-80081272aad0', 'volume_size': 1} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (c8116c0f-9344-413a-b83d-496b7d0fc3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064d849c-4ca5-441e-bf22-7061564aa020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064d849c-4ca5-441e-bf22-7061564aa020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820369572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdb8320-08dc-4746-822e-220ffb16c10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:17Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ee05f8-985b-4019-a80f-a12506d93d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ee05f8-985b-4019-a80f-a12506d93d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d9b7d5-e186-4bbe-9379-0f4a86aac51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d9b7d5-e186-4bbe-9379-0f4a86aac51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbdb8320-08dc-4746-822e-220ffb16c10c', 'volume_name': 'volume-bbdb8320-08dc-4746-822e-220ffb16c10c', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0ced71-fa05-4837-9e1e-29abe8134feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0ced71-fa05-4837-9e1e-29abe8134feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ad66df-0f3d-41d3-ba16-d0cb7b050955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:16 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume bbdb8320-08dc-4746-822e-220ffb16c10c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbdb8320-08dc-4746-822e-220ffb16c10c', 'volume_size': 1} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:16 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9" returned: 0 in 0.896s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.397s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-192116177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34f4450-abe0-431e-aa6b-9a6d55cdb03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:15Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Creating volume f34f4450-abe0-431e-aa6b-9a6d55cdb03b {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:17 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e48c16-0ba7-4b41-9bf9-18805baafb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:17 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b 1073741824 Apr 24 19:57:17 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b34d2cc-e368-47e3-ab6f-53d9bcc87eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:17 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 (f1dd5b1e-19a0-49a0-b492-b6af35bffda9): created successfully Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b34d2cc-e368-47e3-ab6f-53d9bcc87eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (5ad6b135-5038-4f7b-9da3-bd4266344095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:17 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f9b65b97-5a9f-4e6e-aad2-8bcdd9d7889f tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created volume successfully. Apr 24 19:57:17 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b 1073741824" returned: 0 in 0.911s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:17 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b Apr 24 19:57:17 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:18 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b" returned: 0 in 0.560s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.731s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1210471404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574fbbcd-187c-4178-947e-13cbd64eaede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:15Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Creating volume 574fbbcd-187c-4178-947e-13cbd64eaede {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:18 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0c31df-d247-425a-932a-b3d6df5d515e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9aee74a-9cba-4625-b35e-47c70dbdb80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:18 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede 1073741824 Apr 24 19:57:18 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:18 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b (f34f4450-abe0-431e-aa6b-9a6d55cdb03b): created successfully Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9aee74a-9cba-4625-b35e-47c70dbdb80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (89e1bc1a-216e-4141-b926-976008375c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:18 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-16d69034-143b-402d-ae7a-f53ad7663582 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created volume successfully. Apr 24 19:57:19 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede 1073741824" returned: 0 in 0.879s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:19 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede Apr 24 19:57:19 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:19 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede" returned: 0 in 0.510s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1192163292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e06a08-cc06-40e7-aeb4-2de1ed4ef472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:16Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Creating volume 56e06a08-cc06-40e7-aeb4-2de1ed4ef472 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:19 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:20 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 1073741824 Apr 24 19:57:20 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94977628-892f-484d-ba1b-34054d0cf138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574fbbcd-187c-4178-947e-13cbd64eaede', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e821e5d-f3a5-4d3c-bb67-b1e8261f9f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:20 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Volume volume-574fbbcd-187c-4178-947e-13cbd64eaede (574fbbcd-187c-4178-947e-13cbd64eaede): created successfully Apr 24 19:57:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e821e5d-f3a5-4d3c-bb67-b1e8261f9f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (f1b529ea-f66f-49a1-aef4-f33d474c3df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-dc604daa-1d6a-43c4-b79b-42b091bb1cfb tempest-VolumesActionsTest-1827524784 None] Created volume successfully. Apr 24 19:57:20 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 1073741824" returned: 0 in 0.828s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:20 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 Apr 24 19:57:20 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:21 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472" returned: 0 in 0.590s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.062s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085570889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c19a10-bdea-405e-ac54-80081272aad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:16Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Creating volume 85c19a10-bdea-405e-ac54-80081272aad0 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:21 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:21 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0 1073741824 Apr 24 19:57:21 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Acquiring lock "cinder-574fbbcd-187c-4178-947e-13cbd64eaede-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd96baca-5dcc-4359-a50f-300a6d4ff72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1a64fb-4a6b-458b-8c6a-a309e740b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Lock "cinder-574fbbcd-187c-4178-947e-13cbd64eaede-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:21 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 (56e06a08-cc06-40e7-aeb4-2de1ed4ef472): created successfully Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1a64fb-4a6b-458b-8c6a-a309e740b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (448ffee0-5468-4277-ac15-a38d39d51b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:21 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-764bea56-af65-49c4-b27c-3ca51af5a058 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created volume successfully. Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Acquiring lock "cinder-quobyte-574fbbcd-187c-4178-947e-13cbd64eaede" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Lock "cinder-quobyte-574fbbcd-187c-4178-947e-13cbd64eaede" acquired by "delete_volume" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba410e58-bc57-4809-80ef-2ffb40b8d6fe]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:21 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede Apr 24 19:57:21 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:22 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0 1073741824" returned: 0 in 0.941s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:22 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0 Apr 24 19:57:22 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:22 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede" returned: 0 in 0.814s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:22 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede Apr 24 19:57:22 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:23 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0" returned: 0 in 0.748s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.395s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820369572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdb8320-08dc-4746-822e-220ffb16c10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3963b97262404aab0014bc9d4f1693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:17Z,use_quota=True,user_id='d40e424a1ed840e78bb058886ca72de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Creating volume bbdb8320-08dc-4746-822e-220ffb16c10c {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:23 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:23 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d250cc45-a1cb-43bb-98ad-8503e38ddc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c19a10-bdea-405e-ac54-80081272aad0', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160f2944-a4eb-4992-929a-a25761bb71c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:23 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c 1073741824 Apr 24 19:57:23 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-574fbbcd-187c-4178-947e-13cbd64eaede" returned: 0 in 0.683s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:23 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume volume-85c19a10-bdea-405e-ac54-80081272aad0 (85c19a10-bdea-405e-ac54-80081272aad0): created successfully Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160f2944-a4eb-4992-929a-a25761bb71c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (9f282cd9-a4f3-43c3-9fd5-f06b530fb942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Lock "cinder-quobyte-574fbbcd-187c-4178-947e-13cbd64eaede" released by "delete_volume" :: held 1.577s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:23 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1142a9f2-a4f2-44e0-a945-278f8ac3c9d2 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created volume successfully. Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Created reservations ['0358d87d-9771-4357-8229-1481a5a729f3', '4efd618f-b9c4-4e42-b0bf-2a4c78378d4e', '8cbf529f-d02d-4907-8a26-5abb34fe60a6', '3fc9e12e-1789-4049-8d53-fdeeb2b88c45'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:23 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:23 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:24 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.791s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:24 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Deleted volume successfully. Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e621309e-bbe4-483c-ba43-726597de9877 tempest-VolumesActionsTest-537856109 None] Lock "cinder-574fbbcd-187c-4178-947e-13cbd64eaede-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (b6472ff3-51a6-4ead-ac3c-683eb4ad36c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a0a809-04f2-429b-adf5-a28012946e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a0a809-04f2-429b-adf5-a28012946e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1594969630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:24Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee58e79-1b22-4267-9631-ac18fcb92cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee58e79-1b22-4267-9631-ac18fcb92cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:24 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e8ab9-b214-49fa-84a2-2f4f16d7dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e8ab9-b214-49fa-84a2-2f4f16d7dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23', 'volume_name': 'volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fc2d22-f267-467b-b8ca-ee2940236b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fc2d22-f267-467b-b8ca-ee2940236b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08830b4-6cd0-40a9-8d7c-b0c2a1d6ba34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:24 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Volume ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23', 'volume_size': 1} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c 1073741824" returned: 0 in 1.308s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:24 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c Apr 24 19:57:24 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:25 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c" returned: 0 in 0.614s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1594969630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:24Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Creating volume ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:25 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ad66df-0f3d-41d3-ba16-d0cb7b050955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbdb8320-08dc-4746-822e-220ffb16c10c', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:25 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 1073741824 Apr 24 19:57:25 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fd5c65-4580-45c0-b576-c5f1bd381d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:25 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Volume volume-bbdb8320-08dc-4746-822e-220ffb16c10c (bbdb8320-08dc-4746-822e-220ffb16c10c): created successfully Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fd5c65-4580-45c0-b576-c5f1bd381d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Flow 'volume_create_manager' (c8116c0f-9344-413a-b83d-496b7d0fc3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:25 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f892870a-78a6-43be-a43a-170f058f2ac4 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created volume successfully. Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-bbdb8320-08dc-4746-822e-220ffb16c10c-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-bbdb8320-08dc-4746-822e-220ffb16c10c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-quobyte-bbdb8320-08dc-4746-822e-220ffb16c10c" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-bbdb8320-08dc-4746-822e-220ffb16c10c" acquired by "delete_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[77410bd5-6f31-47ad-b5c2-5c0114216d53]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:26 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 1073741824" returned: 0 in 0.864s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:26 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c Apr 24 19:57:26 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:26 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 Apr 24 19:57:26 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:26 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c" returned: 0 in 0.690s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:26 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c Apr 24 19:57:26 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:26 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23" returned: 0 in 0.625s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08830b4-6cd0-40a9-8d7c-b0c2a1d6ba34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941dabdd-e3cf-48eb-9407-b0dd75d8bd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:26 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Volume volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 (ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23): created successfully Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941dabdd-e3cf-48eb-9407-b0dd75d8bd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (b6472ff3-51a6-4ead-ac3c-683eb4ad36c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:26 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e5d350f6-8ec3-4633-a774-5bca5859858c tempest-VolumesActionsTest-1827524784 None] Created volume successfully. Apr 24 19:57:27 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bbdb8320-08dc-4746-822e-220ffb16c10c" returned: 0 in 0.528s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-bbdb8320-08dc-4746-822e-220ffb16c10c" released by "delete_volume" :: held 1.260s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created reservations ['966f76b5-f6ee-41dc-b62e-d1b72c2cc39b', 'bcb323a3-d301-4c10-a2d6-57f916ed547a', '0122ae35-d01e-48e7-b1bf-0cc229334529', 'f97296f9-4c6b-43f2-b605-4799c6d2d8e3'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:27 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:27 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:27 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.567s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Flow 'volume_create_manager' (2ed0ac57-d9d0-4355-8f57-8aeb6fe55a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90d0e31-898f-4bc1-95c8-48d30fa0394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:27 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Deleted volume successfully. Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90d0e31-898f-4bc1-95c8-48d30fa0394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-815866094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a252f28b-bebb-4b4b-ae60-c649e0bcd224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f857439529a4bd9b9df03baf7b338d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:28Z,use_quota=True,user_id='7178bd0150494d9d84e9b726bd8e9139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feb1dff-e346-4ae4-a173-db71f5911660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feb1dff-e346-4ae4-a173-db71f5911660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d622b006-d307-45d0-8269-befe64dde6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d622b006-d307-45d0-8269-befe64dde6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a252f28b-bebb-4b4b-ae60-c649e0bcd224', 'volume_name': 'volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfb80ee-807c-405d-9bf3-1ab3ba253f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfb80ee-807c-405d-9bf3-1ab3ba253f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a9fc2f-6702-4540-9c11-ae3fc0d11684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:28 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Volume a252f28b-bebb-4b4b-ae60-c649e0bcd224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224', 'volume_size': 1} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-815866094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a252f28b-bebb-4b4b-ae60-c649e0bcd224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f857439529a4bd9b9df03baf7b338d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:28Z,use_quota=True,user_id='7178bd0150494d9d84e9b726bd8e9139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Creating volume a252f28b-bebb-4b4b-ae60-c649e0bcd224 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:28 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5d97b3d9-e29e-421d-a93b-e0746a3ddfc9 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-bbdb8320-08dc-4746-822e-220ffb16c10c-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:28 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 1073741824 Apr 24 19:57:28 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-85c19a10-bdea-405e-ac54-80081272aad0-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-85c19a10-bdea-405e-ac54-80081272aad0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Acquiring lock "cinder-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-quobyte-85c19a10-bdea-405e-ac54-80081272aad0" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Lock "cinder-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-85c19a10-bdea-405e-ac54-80081272aad0" acquired by "delete_volume" :: waited 0.059s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Acquiring lock "cinder-quobyte-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d2bb11-f4a6-4390-96cd-e8804c257c71]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Lock "cinder-quobyte-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23" acquired by "delete_volume" :: waited 0.029s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938f1ba-2c6e-4a03-8881-43301d1f6e6d]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:28 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0 Apr 24 19:57:28 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:28 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 Apr 24 19:57:28 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:28 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 1073741824" returned: 0 in 0.852s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:29 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 Apr 24 19:57:29 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:29 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0" returned: 0 in 0.741s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:29 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23" returned: 0 in 0.735s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:29 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0 Apr 24 19:57:29 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:29 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23 Apr 24 19:57:29 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:29 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224" returned: 0 in 0.474s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a9fc2f-6702-4540-9c11-ae3fc0d11684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31552ed2-147a-45b7-859b-16d4c4b2d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:29 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Volume volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 (a252f28b-bebb-4b4b-ae60-c649e0bcd224): created successfully Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31552ed2-147a-45b7-859b-16d4c4b2d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Flow 'volume_create_manager' (2ed0ac57-d9d0-4355-8f57-8aeb6fe55a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:29 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e15e916c-8674-4f88-921c-025d5d9d9a44 tempest-VolumeQuotasAdminTestJSON-1486877034 None] Created volume successfully. Apr 24 19:57:29 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-85c19a10-bdea-405e-ac54-80081272aad0" returned: 0 in 0.590s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-85c19a10-bdea-405e-ac54-80081272aad0" released by "delete_volume" :: held 1.384s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:29 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23" returned: 0 in 0.593s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Lock "cinder-quobyte-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23" released by "delete_volume" :: held 1.375s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created reservations ['808957d2-293e-4799-8f03-ab6a23a2269a', 'b4968501-8735-4c62-9430-936f24f2bf8a', '34e073ec-a091-4ca3-bfd3-252d544cc48d', '7e55df11-f8af-4669-8834-777ed0905a67'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Created reservations ['53b383c2-a55b-4e43-8ded-e2155d6578a4', '1f11c394-be1e-4be5-a7de-a948de7a7196', '7bacf08a-00bf-4f81-83ca-aa0a331f719a', 'e3a801ec-7f1b-4b22-a7cf-b51940f66fe8'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:29 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:29 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:29 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:29 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Acquiring lock "cinder-a252f28b-bebb-4b4b-ae60-c649e0bcd224-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "cinder-a252f28b-bebb-4b4b-ae60-c649e0bcd224-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Acquiring lock "cinder-quobyte-a252f28b-bebb-4b4b-ae60-c649e0bcd224" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "cinder-quobyte-a252f28b-bebb-4b4b-ae60-c649e0bcd224" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e39a5fd-48b8-4019-bef3-86bbd9998341]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:30 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.557s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Deleted volume successfully. Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f3fdb156-0180-49a8-8bbf-914780d956f6 tempest-VolumesActionsTest-537856109 None] Lock "cinder-ef6a2ad7-30d7-4b6d-8c1f-868358bbcc23-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:30 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 Apr 24 19:57:30 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:30 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.634s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Deleted volume successfully. Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6a439b94-14d9-49bf-ae59-a2b19d5aa919 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-85c19a10-bdea-405e-ac54-80081272aad0-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-56e06a08-cc06-40e7-aeb4-2de1ed4ef472-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-56e06a08-cc06-40e7-aeb4-2de1ed4ef472-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-quobyte-56e06a08-cc06-40e7-aeb4-2de1ed4ef472" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-56e06a08-cc06-40e7-aeb4-2de1ed4ef472" acquired by "delete_volume" :: waited 0.014s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b7a713-eb15-461d-b19b-5975d7d98dc8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:30 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 Apr 24 19:57:30 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (5034ce31-2e10-4dcb-b425-06f3bf07fe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d73a889-9634-4997-a91e-c25a6460a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d73a889-9634-4997-a91e-c25a6460a287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779288807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:31Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe14580e-5378-4531-8394-e59b9f916325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe14580e-5378-4531-8394-e59b9f916325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89b6dac-2dda-4e04-83ba-8409d03096c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:31 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89b6dac-2dda-4e04-83ba-8409d03096c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8', 'volume_name': 'volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a2705f-3be0-4bd4-b183-a22b5b161efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a2705f-3be0-4bd4-b183-a22b5b161efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376a7e1b-2176-4105-856e-40aa4f0b484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:31 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Volume 2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8', 'volume_size': 1} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-779288807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:31Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Creating volume 2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:31 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224" returned: 0 in 0.825s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:31 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 1073741824 Apr 24 19:57:31 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:31 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224 Apr 24 19:57:31 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:31 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472" returned: 0 in 0.775s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:31 devstack sudo[87744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472 Apr 24 19:57:31 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:31 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a252f28b-bebb-4b4b-ae60-c649e0bcd224" returned: 0 in 0.736s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "cinder-quobyte-a252f28b-bebb-4b4b-ae60-c649e0bcd224" released by "delete_volume" :: held 1.604s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:31 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 1073741824" returned: 0 in 0.787s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Created reservations ['29af8c7b-b77a-4cf7-ae1d-e33265955705', '86b63538-904c-4533-91f5-ee1a903d6f25', 'd90e291e-6108-41e3-acf1-3d24797d75ce', '81cfb350-51e6-49fb-ad7b-3c04e8827c4e'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:32 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 Apr 24 19:57:32 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:32 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-56e06a08-cc06-40e7-aeb4-2de1ed4ef472" returned: 0 in 0.595s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-56e06a08-cc06-40e7-aeb4-2de1ed4ef472" released by "delete_volume" :: held 1.438s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created reservations ['1017b502-ab6f-46f8-9998-b8b8f21e69c1', 'b9ea7ce6-b24a-40a8-bb5d-6ea442d5b3a2', 'd9073009-b4bd-48f8-a718-6436960802b6', '2ae32e71-7d31-458f-93cc-c4ee131b53e9'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:32 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:32 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:32 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:32 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:32 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8" returned: 0 in 0.657s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376a7e1b-2176-4105-856e-40aa4f0b484c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daae92a5-2c86-4f0c-a027-3c2399c2c2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:32 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Volume volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 (2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8): created successfully Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daae92a5-2c86-4f0c-a027-3c2399c2c2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (5034ce31-2e10-4dcb-b425-06f3bf07fe3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:32 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-579efe37-9ff8-494a-8c52-75737e035f7b tempest-VolumesActionsTest-1827524784 None] Created volume successfully. Apr 24 19:57:32 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.565s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:32 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Deleted volume successfully. Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8c93cfd-aaff-4a2b-84ab-7c19111f52de tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "cinder-a252f28b-bebb-4b4b-ae60-c649e0bcd224-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-f34f4450-abe0-431e-aa6b-9a6d55cdb03b-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:32 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.620s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:32 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Deleted volume successfully. Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-f34f4450-abe0-431e-aa6b-9a6d55cdb03b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2f94853f-9188-4d9e-a8a9-43529d5a286e tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-56e06a08-cc06-40e7-aeb4-2de1ed4ef472-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-quobyte-f34f4450-abe0-431e-aa6b-9a6d55cdb03b" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-f34f4450-abe0-431e-aa6b-9a6d55cdb03b" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daa3b7f-d3ee-427d-9cae-2a3a6b27904a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:33 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b Apr 24 19:57:33 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Flow 'volume_create_manager' (0889bf02-a66a-4c5a-a42c-6bc6794bca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033695d4-8eab-4e5e-8279-7129cfb6d9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033695d4-8eab-4e5e-8279-7129cfb6d9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-781521798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f857439529a4bd9b9df03baf7b338d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:33Z,use_quota=True,user_id='7178bd0150494d9d84e9b726bd8e9139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6823e34-bcd6-4809-ab71-e8c80dccad91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6823e34-bcd6-4809-ab71-e8c80dccad91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a0bc63-a03d-48b6-be55-6c9639efa376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a0bc63-a03d-48b6-be55-6c9639efa376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a', 'volume_name': 'volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217c4592-5dc3-4f3d-a669-8f24e0b0ec18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217c4592-5dc3-4f3d-a669-8f24e0b0ec18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638e3131-7691-4048-8a78-629f49f663b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:33 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Volume 5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a', 'volume_size': 1} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-781521798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f857439529a4bd9b9df03baf7b338d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:33Z,use_quota=True,user_id='7178bd0150494d9d84e9b726bd8e9139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Creating volume 5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:33 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:33 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a 1073741824 Apr 24 19:57:33 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Acquiring lock "cinder-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Lock "cinder-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Acquiring lock "cinder-quobyte-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Lock "cinder-quobyte-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0362a673-2bed-417f-9173-e79ac7bd244e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:33 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 Apr 24 19:57:33 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:33 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b" returned: 0 in 0.696s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:33 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b Apr 24 19:57:33 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:34 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a 1073741824" returned: 0 in 0.923s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:34 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a Apr 24 19:57:34 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:34 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f34f4450-abe0-431e-aa6b-9a6d55cdb03b" returned: 0 in 0.598s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-f34f4450-abe0-431e-aa6b-9a6d55cdb03b" released by "delete_volume" :: held 1.371s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:34 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8" returned: 0 in 0.825s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created reservations ['ec080e48-fbdc-42df-a2df-f8e8edc06407', 'c09458cf-5ce7-4f17-8334-ddd7d706a11f', '37fdc04c-d493-4713-b893-3066fcd0463c', 'a6d1484b-8262-45ef-bd3c-0df0c0bece8e'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:34 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8 Apr 24 19:57:34 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:34 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:34 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:34 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a" returned: 0 in 0.576s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638e3131-7691-4048-8a78-629f49f663b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba459f05-168e-4955-a9b0-b20ed6354a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:34 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Volume volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a (5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a): created successfully Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba459f05-168e-4955-a9b0-b20ed6354a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Flow 'volume_create_manager' (0889bf02-a66a-4c5a-a42c-6bc6794bca9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:34 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-983aab4f-4a0b-4fb2-86c5-126ebdd7574d tempest-VolumeQuotasAdminTestJSON-1486877034 None] Created volume successfully. Apr 24 19:57:34 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8" returned: 0 in 0.547s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Lock "cinder-quobyte-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8" released by "delete_volume" :: held 1.424s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Created reservations ['32abdfed-d851-4d84-8465-a2dd0bc75dbc', 'f9ebab8c-49af-4632-a13a-efc06743db4f', '14de317a-c9ed-4bcb-95a4-8371dde606b3', '4453c8ee-8c4b-4d08-826a-70d316d1b245'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-f1dd5b1e-19a0-49a0-b492-b6af35bffda9-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:35 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.647s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-f1dd5b1e-19a0-49a0-b492-b6af35bffda9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:35 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:35 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:35 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Deleted volume successfully. Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-quobyte-f1dd5b1e-19a0-49a0-b492-b6af35bffda9" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1bb82289-dad5-4192-ab31-cfe79e773943 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-f34f4450-abe0-431e-aa6b-9a6d55cdb03b-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-f1dd5b1e-19a0-49a0-b492-b6af35bffda9" acquired by "delete_volume" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f6372e-48e9-4c20-80fe-0d8f0e834948]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:35 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 Apr 24 19:57:35 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:35 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Flow 'volume_create_manager' (19f47a5a-1805-4b17-8e34-527a4d86de19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84fec9f4-ff2c-43aa-ae3a-142d2986ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.816s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:35 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:35 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Deleted volume successfully. Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84fec9f4-ff2c-43aa-ae3a-142d2986ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-914925135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f84919-1cfe-4225-ad06-c56a63932575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e94775ed7d4fdb81eb88c98fbb3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:36Z,use_quota=True,user_id='4162dab748c7476abe72b924b08d664d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4048693d-3569-4aa6-aac5-4e17b0a67937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4048693d-3569-4aa6-aac5-4e17b0a67937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a68fd4-ddb8-401d-b831-7b777742bca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a68fd4-ddb8-401d-b831-7b777742bca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f84919-1cfe-4225-ad06-c56a63932575', 'volume_name': 'volume-b8f84919-1cfe-4225-ad06-c56a63932575', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:36 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4913dbd5-3ed8-4b35-a104-f3a52b498f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4913dbd5-3ed8-4b35-a104-f3a52b498f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ddaa8e-73ad-4d80-b925-19350d0025b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:36 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Volume b8f84919-1cfe-4225-ad06-c56a63932575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f84919-1cfe-4225-ad06-c56a63932575', 'volume_size': 1} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-914925135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f84919-1cfe-4225-ad06-c56a63932575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e94775ed7d4fdb81eb88c98fbb3e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:36Z,use_quota=True,user_id='4162dab748c7476abe72b924b08d664d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Creating volume b8f84919-1cfe-4225-ad06-c56a63932575 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:36 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:36 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 1073741824 Apr 24 19:57:36 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9" returned: 0 in 0.787s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-23fc1ce3-17de-46e1-bd44-6a88cdc482f4 tempest-VolumesActionsTest-537856109 None] Lock "cinder-2fd6ec70-11c0-4775-8fdf-ce7effaa1eb8-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:36 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a4daf54a-c5a9-4c82-bb34-e0d513309b47 tempest-VolumeQuotasAdminTestJSON-758124814 None] Transfer volume completed successfully. Apr 24 19:57:36 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9 Apr 24 19:57:36 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (58e59f91-2c8d-4f11-bdc1-2edbf53c14f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d58e105-cc00-4db8-97cc-b510f67de6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d58e105-cc00-4db8-97cc-b510f67de6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1099898399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680d6220-861e-4e70-ac87-adfd24adbb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:36Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ce07bc-b470-4369-8cd2-dd3b7ca27e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ce07bc-b470-4369-8cd2-dd3b7ca27e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ea3f9f-b15b-47ae-bfd8-7d07772031a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ea3f9f-b15b-47ae-bfd8-7d07772031a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680d6220-861e-4e70-ac87-adfd24adbb05', 'volume_name': 'volume-680d6220-861e-4e70-ac87-adfd24adbb05', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b3a5c1-b775-41f3-8bdf-7b7e65cb9777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b3a5c1-b775-41f3-8bdf-7b7e65cb9777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2aadd9-67d0-4b9d-9b42-c21c2482dde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:36 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Volume 680d6220-861e-4e70-ac87-adfd24adbb05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680d6220-861e-4e70-ac87-adfd24adbb05', 'volume_size': 1} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:36 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1dd5b1e-19a0-49a0-b492-b6af35bffda9" returned: 0 in 0.565s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-f1dd5b1e-19a0-49a0-b492-b6af35bffda9" released by "delete_volume" :: held 1.394s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created reservations ['8a241779-ee6e-4f4c-8023-65891ea57148', '5a7b4329-1ff1-4432-a919-f33883294850', '4fad25ba-3378-427f-ae01-4c90cecb04c1', 'd876dbd4-ff38-4509-96c6-f3d0198a5658'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:36 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 1073741824" returned: 0 in 0.738s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:36 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:36 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:36 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 Apr 24 19:57:36 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Acquiring lock "cinder-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Lock "cinder-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Acquiring lock "cinder-quobyte-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Lock "cinder-quobyte-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b58ea0-8091-4158-b11b-be850f29dccd]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:37 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a Apr 24 19:57:37 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:37 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.537s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:37 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Deleted volume successfully. Apr 24 19:57:37 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575" returned: 0 in 0.501s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1099898399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680d6220-861e-4e70-ac87-adfd24adbb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:36Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Creating volume 680d6220-861e-4e70-ac87-adfd24adbb05 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:37 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-def2fc85-2bb3-4d78-a35a-4cdf8f7301ed tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-f1dd5b1e-19a0-49a0-b492-b6af35bffda9-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:37 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05 1073741824 Apr 24 19:57:37 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ddaa8e-73ad-4d80-b925-19350d0025b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f84919-1cfe-4225-ad06-c56a63932575', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0df5c0-92b2-4471-b918-48ad15f284a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:37 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Volume volume-b8f84919-1cfe-4225-ad06-c56a63932575 (b8f84919-1cfe-4225-ad06-c56a63932575): created successfully Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0df5c0-92b2-4471-b918-48ad15f284a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Flow 'volume_create_manager' (19f47a5a-1805-4b17-8e34-527a4d86de19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:37 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-183136d3-f721-4dd8-9099-4d4a487ce1c4 tempest-SnapshotMetadataTestJSON-1547418021 None] Created volume successfully. Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-0921bddb-e005-4a43-9522-b20dcb325e33-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-0921bddb-e005-4a43-9522-b20dcb325e33-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "cinder-quobyte-0921bddb-e005-4a43-9522-b20dcb325e33" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-0921bddb-e005-4a43-9522-b20dcb325e33" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f5b9e8-a11d-48ed-8bd5-be5b79648057]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:37 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33 Apr 24 19:57:37 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:37 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a" returned: 0 in 0.578s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:37 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a Apr 24 19:57:37 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:38 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05 1073741824" returned: 0 in 0.699s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:38 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:38 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05 Apr 24 19:57:38 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33" returned: 0 in 0.595s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:38 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33 Apr 24 19:57:38 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:38 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a" returned: 0 in 0.594s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Lock "cinder-quobyte-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a" released by "delete_volume" :: held 1.217s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Created reservations ['03baac0c-4b6e-4f00-b2a1-f45f4014a1f1', 'd771123a-1eb9-4972-8089-8f881c46bab5', 'da9ef60d-5b35-4ce4-a827-734466020bc8', '50a9de1c-b345-4884-af37-dec4524c49d0'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:38 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:38 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:38 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05" returned: 0 in 0.555s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.360s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2aadd9-67d0-4b9d-9b42-c21c2482dde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680d6220-861e-4e70-ac87-adfd24adbb05', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68212a9e-0e30-4f33-a300-873bb168fc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Creating offline snapshot 9bd03dba-e756-4dc3-913a-fd4719b14520 of volume b8f84919-1cfe-4225-ad06-c56a63932575 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:57:38 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Volume volume-680d6220-861e-4e70-ac87-adfd24adbb05 (680d6220-861e-4e70-ac87-adfd24adbb05): created successfully Apr 24 19:57:38 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68212a9e-0e30-4f33-a300-873bb168fc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (58e59f91-2c8d-4f11-bdc1-2edbf53c14f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c0797f-6fb9-4670-aafb-7f3f3b6c1f31]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:38 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-125257bb-1765-41a4-be04-1fc0f7f976bd tempest-VolumesActionsTest-1827524784 None] Created volume successfully. Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0921bddb-e005-4a43-9522-b20dcb325e33" returned: 0 in 0.591s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-quobyte-0921bddb-e005-4a43-9522-b20dcb325e33" released by "delete_volume" :: held 1.226s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:38 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 Apr 24 19:57:38 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Created reservations ['63942092-0ac6-4a9b-9816-fad500f88f44', '7ba9a801-cc2a-428a-8cc0-1e8cd6b31b39', '47f26464-31c9-4bfe-9497-be96d3dd0ea2', '41f096ab-51a3-4ca1-848c-af98d5213e6a'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:38 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:38 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:38 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.525s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:38 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Deleted volume successfully. Apr 24 19:57:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5ae9c3f2-fb26-4f87-91df-57378552a47d tempest-VolumeQuotasAdminTestJSON-1103293483 None] Lock "cinder-5fd7f0ec-05ec-43d5-9b90-3e4997e1f40a-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:39 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575" returned: 0 in 0.603s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:39 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 1G Apr 24 19:57:39 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:39 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.509s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Deleted volume successfully. Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-49662fcd-758c-44d5-adb1-5fbfefec1f78 tempest-CreateVolumesFromSourceVolumeTest-280650999 None] Lock "cinder-0921bddb-e005-4a43-9522-b20dcb325e33-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Acquiring lock "cinder-680d6220-861e-4e70-ac87-adfd24adbb05-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Lock "cinder-680d6220-861e-4e70-ac87-adfd24adbb05-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Acquiring lock "cinder-quobyte-680d6220-861e-4e70-ac87-adfd24adbb05" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Lock "cinder-quobyte-680d6220-861e-4e70-ac87-adfd24adbb05" acquired by "delete_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf923a6d-d15f-43a6-ac3d-db45577587f1]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:40 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05 Apr 24 19:57:40 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:40 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 1G" returned: 0 in 0.744s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f84919-1cfe-4225-ad06-c56a63932575 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:40 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f84919-1cfe-4225-ad06-c56a63932575 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 Apr 24 19:57:40 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:40 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05" returned: 0 in 0.596s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:40 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05 Apr 24 19:57:40 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:40 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8f84919-1cfe-4225-ad06-c56a63932575 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520" returned: 0 in 0.684s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:40 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 is being set with open permissions: ugo+rw Apr 24 19:57:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:40 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 Apr 24 19:57:40 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:41 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-680d6220-861e-4e70-ac87-adfd24adbb05" returned: 0 in 0.525s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Lock "cinder-quobyte-680d6220-861e-4e70-ac87-adfd24adbb05" released by "delete_volume" :: held 1.180s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Created reservations ['5d9af65a-c1cf-443b-9f6c-6b6f24d59410', '270db225-7f01-43b9-aca4-0749138e5084', '743cd41f-c234-43e8-ba3f-3306cc28088c', 'ac669ec8-f632-4e2e-be39-d826e1f8abb2'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:41 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:41 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:41 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520" returned: 0 in 0.693s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:41 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.info Apr 24 19:57:41 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:41 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.595s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:41 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Deleted volume successfully. Apr 24 19:57:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5f8e255-0ba5-42db-a720-54187fbcfa1f tempest-VolumesActionsTest-537856109 None] Lock "cinder-680d6220-861e-4e70-ac87-adfd24adbb05-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:42 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.info" returned: 0 in 0.614s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:42 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.info is being set with open permissions: ugo+rw Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:42 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.info Apr 24 19:57:42 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (7071a2fa-f486-402f-b0b8-0b3174f01b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416c432a-a787-4628-8815-d492046ee1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416c432a-a787-4628-8815-d492046ee1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-69796097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fae2eeb-ce22-413f-b7fe-b20c2587623c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:42Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde398b9-c52c-4503-abb9-972e9184a9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde398b9-c52c-4503-abb9-972e9184a9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed9393a-1d0b-43ba-b29f-1841acba4ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed9393a-1d0b-43ba-b29f-1841acba4ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fae2eeb-ce22-413f-b7fe-b20c2587623c', 'volume_name': 'volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1543eb-ac59-41f6-b392-5ced1c9bbb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1543eb-ac59-41f6-b392-5ced1c9bbb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f6ae71-f16e-4784-b314-ffc4c62a1f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:42 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Volume 3fae2eeb-ce22-413f-b7fe-b20c2587623c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c', 'volume_size': 1} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:42 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.info" returned: 0 in 0.522s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.988s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-69796097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fae2eeb-ce22-413f-b7fe-b20c2587623c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e5a8801b4f4b9ca309fa3041c1fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:42Z,use_quota=True,user_id='8f1f5a88d5f84aeb9813e99952bb9593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Creating volume 3fae2eeb-ce22-413f-b7fe-b20c2587623c {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:42 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:42 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c 1073741824 Apr 24 19:57:42 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:42 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8db3c484-516e-4af8-a85b-0778d4305278 tempest-SnapshotMetadataTestJSON-1547418021 None] Create snapshot completed successfully Apr 24 19:57:43 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c 1073741824" returned: 0 in 0.674s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:43 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c Apr 24 19:57:43 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:43 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c" returned: 0 in 0.565s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f6ae71-f16e-4784-b314-ffc4c62a1f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29372bec-16c4-44e8-bf99-db84bcb3fb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:43 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Volume volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c (3fae2eeb-ce22-413f-b7fe-b20c2587623c): created successfully Apr 24 19:57:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29372bec-16c4-44e8-bf99-db84bcb3fb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Flow 'volume_create_manager' (7071a2fa-f486-402f-b0b8-0b3174f01b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:44 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a026f976-89ca-4b20-8d78-fb448d89b1dc tempest-VolumesActionsTest-1827524784 None] Created volume successfully. Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Acquiring lock "cinder-9bd03dba-e756-4dc3-913a-fd4719b14520-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-9bd03dba-e756-4dc3-913a-fd4719b14520-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Acquiring lock "cinder-quobyte-b8f84919-1cfe-4225-ad06-c56a63932575" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-quobyte-b8f84919-1cfe-4225-ad06-c56a63932575" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Acquiring lock "cinder-quobyte-9bd03dba-e756-4dc3-913a-fd4719b14520" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-quobyte-9bd03dba-e756-4dc3-913a-fd4719b14520" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Deleting offline snapshot 9bd03dba-e756-4dc3-913a-fd4719b14520 of volume b8f84919-1cfe-4225-ad06-c56a63932575 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] snapshot_file for this snap is: volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcd2d3d-a623-4a69-b3ab-1534f00c0041]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:44 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 Apr 24 19:57:44 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:45 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520" returned: 0 in 0.605s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8f84919-1cfe-4225-ad06-c56a63932575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[af068ce1-1faa-48d4-b09b-3dc5610afcd8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:45 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 Apr 24 19:57:45 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Acquiring lock "cinder-3fae2eeb-ce22-413f-b7fe-b20c2587623c-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Lock "cinder-3fae2eeb-ce22-413f-b7fe-b20c2587623c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Acquiring lock "cinder-quobyte-3fae2eeb-ce22-413f-b7fe-b20c2587623c" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Lock "cinder-quobyte-3fae2eeb-ce22-413f-b7fe-b20c2587623c" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b463a9-e074-4a60-9f52-0a0e2903aaff]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:45 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c Apr 24 19:57:45 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:45 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575" returned: 0 in 0.612s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:45 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 Apr 24 19:57:45 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Flow 'volume_create_manager' (507157fa-fcbf-4b82-b3a4-a69c13ef4bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bcba3d-db2d-4abc-b015-8240a81f7c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bcba3d-db2d-4abc-b015-8240a81f7c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1345302282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc578848-fd46-4b96-b42a-266e37195d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3c20eff9d545ee887f2850de8e4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:46Z,use_quota=True,user_id='2dc75aaac9e04358a587d1fdf1240319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fc7237-d6ae-43b2-bbf8-a00d5942ffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fc7237-d6ae-43b2-bbf8-a00d5942ffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1617330-bd54-4d90-92db-dd23b14fc750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:45 devstack cinder-volume[81641]: DEBUG cinder.image.glance [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Creating Keystone auth plugin from conf {{(pid=81641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1617330-bd54-4d90-92db-dd23b14fc750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc578848-fd46-4b96-b42a-266e37195d18', 'volume_name': 'volume-cc578848-fd46-4b96-b42a-266e37195d18', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2856cdfa-c9a8-435d-8f50-8fd964b6b3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:46 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2856cdfa-c9a8-435d-8f50-8fd964b6b3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca70690-b437-4248-a3f2-c3be13709eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:46 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Volume cc578848-fd46-4b96-b42a-266e37195d18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc578848-fd46-4b96-b42a-266e37195d18', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Trying to clone cc578848-fd46-4b96-b42a-266e37195d18 from image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]). {{(pid=81641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c" returned: 0 in 0.588s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:46 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c Apr 24 19:57:46 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:46 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:57:46 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520" returned: 0 in 0.671s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:46 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520 Apr 24 19:57:46 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9a0f6d-e0e3-4426-b49a-d2b97a272563]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:46 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD Apr 24 19:57:46 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:46 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3fae2eeb-ce22-413f-b7fe-b20c2587623c" returned: 0 in 0.558s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Lock "cinder-quobyte-3fae2eeb-ce22-413f-b7fe-b20c2587623c" released by "delete_volume" :: held 1.197s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Created reservations ['1010ba05-405e-4051-9db2-98d32e5e31f8', '82d30062-f77a-4644-a89d-09f416129854', 'c36dac83-123b-4f44-8bd5-ef265f51030f', '8e5dbd49-ef98-4810-b178-faee58287ed3'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:46 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:46 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:46 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575.9bd03dba-e756-4dc3-913a-fd4719b14520" returned: 0 in 0.461s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-quobyte-9bd03dba-e756-4dc3-913a-fd4719b14520" released by "_delete_snapshot" :: held 2.474s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-quobyte-b8f84919-1cfe-4225-ad06-c56a63932575" released by "delete_snapshot" :: held 2.500s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:46 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Created reservations ['74535da8-0754-4d5b-a6e9-15720f465d97', 'e594282a-a39a-46d3-9f75-e5e2dde89847', '6da087b8-f189-42bd-89a4-3d2e84289b2f', 'c7203217-1088-41dc-8d90-faf703d99e00'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD" returned: 0 in 0.559s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:46 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Temporary image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 is fetched for user 2dc75aaac9e04358a587d1fdf1240319. {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:57:46 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Delete snapshot completed successfully. Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9479435a-199f-4731-bc0f-69bf8453637d tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-9bd03dba-e756-4dc3-913a-fd4719b14520-delete_snapshot" released by "delete_snapshot" :: held 2.681s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a5753-a30f-486f-b3d8-ffe014724a8b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:47 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD Apr 24 19:57:47 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:47 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.454s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:47 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Deleted volume successfully. Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-41822bae-c03a-4e25-bc9f-f3ff4c76670e tempest-VolumesActionsTest-1827524784 None] Lock "cinder-3fae2eeb-ce22-413f-b7fe-b20c2587623c-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:47 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD" returned: 0 in 0.516s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1345302282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc578848-fd46-4b96-b42a-266e37195d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3c20eff9d545ee887f2850de8e4a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:46Z,use_quota=True,user_id='2dc75aaac9e04358a587d1fdf1240319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Creating volume cc578848-fd46-4b96-b42a-266e37195d18 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:47 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:47 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 1073741824 Apr 24 19:57:47 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Acquiring lock "cinder-b8f84919-1cfe-4225-ad06-c56a63932575-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-b8f84919-1cfe-4225-ad06-c56a63932575-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Acquiring lock "cinder-quobyte-b8f84919-1cfe-4225-ad06-c56a63932575" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-quobyte-b8f84919-1cfe-4225-ad06-c56a63932575" acquired by "delete_volume" :: waited 0.014s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1413788a-0cc8-47d5-b9d2-8a095e21c839]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:47 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 Apr 24 19:57:47 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:48 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 1073741824" returned: 0 in 0.655s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:48 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 Apr 24 19:57:48 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:48 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575" returned: 0 in 0.619s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:48 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575 Apr 24 19:57:48 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:48 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18" returned: 0 in 0.509s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Attempting download of 2f4436ec-2be7-46ed-af6e-ed3ceb305141 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}])) to volume cc578848-fd46-4b96-b42a-266e37195d18. {{(pid=81641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e96a67-32a7-4bc8-836d-0ba3a70e19ee]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_dtad_o9t {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:48 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b8f84919-1cfe-4225-ad06-c56a63932575" returned: 0 in 0.517s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:48 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_dtad_o9t Apr 24 19:57:48 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-quobyte-b8f84919-1cfe-4225-ad06-c56a63932575" released by "delete_volume" :: held 1.202s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:48 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Created reservations ['3aa423ce-435e-42ec-9a4b-af0f44ca2648', '0f8bee6a-f2f3-450e-a9e5-aee05f00e0ad', '6223fafc-2d12-4e73-99e4-f5cae44eae8d', 'd6f4f381-45dd-4e3c-9346-9afaf4a134af'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:49 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:49 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:49 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_dtad_o9t" returned: 0 in 0.550s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_dtad_o9t {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:49 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_dtad_o9t Apr 24 19:57:49 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:49 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.478s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:49 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Deleted volume successfully. Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-758c793a-1fd5-48b5-9bdf-f901c959a5ff tempest-SnapshotMetadataTestJSON-1547418021 None] Lock "cinder-b8f84919-1cfe-4225-ad06-c56a63932575-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:49 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_dtad_o9t" returned: 1 in 0.593s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_dtad_o9t' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fcb999-f3a1-4a75-84a4-b6e147105f2a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:50 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD Apr 24 19:57:50 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:50 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD" returned: 0 in 0.619s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:50 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] 2f4436ec-2be7-46ed-af6e-ed3ceb305141 was qcow2, converting to raw {{(pid=81641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:57:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:50 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 Apr 24 19:57:50 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:52 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18" returned: 0 in 1.706s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:52 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_rab5wen8devstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:57:52 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Converted 112.00 MB image at 65.53 MB/s Apr 24 19:57:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:52 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 1G Apr 24 19:57:52 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:52 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 1G" returned: 0 in 0.666s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0e4055-edc2-4201-85e1-c43ccdb4f6c0]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:53 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:53 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:53 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 Apr 24 19:57:53 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:53 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18" returned: 0 in 0.605s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:53 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.567s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:53 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 Apr 24 19:57:53 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:54 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18" returned: 1 in 0.641s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Downloaded image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}])) to volume cc578848-fd46-4b96-b42a-266e37195d18 successfully. {{(pid=81641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Temporary image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 for user 2dc75aaac9e04358a587d1fdf1240319 is deleted. {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Marking volume cc578848-fd46-4b96-b42a-266e37195d18 as bootable. {{(pid=81641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=176,cinder:INSERT=57,cinder:UPDATE=258,cinder:DELETE=17 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Copying metadata from image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 to cc578848-fd46-4b96-b42a-266e37195d18. {{(pid=81641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Creating volume glance metadata for volume cc578848-fd46-4b96-b42a-266e37195d18 backed by image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=167,cinder:INSERT=58,cinder:UPDATE=208,cinder:DELETE=17 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca70690-b437-4248-a3f2-c3be13709eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc578848-fd46-4b96-b42a-266e37195d18', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2964158d-d366-489b-b7f6-1dc19f9ff937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Volume volume-cc578848-fd46-4b96-b42a-266e37195d18 (cc578848-fd46-4b96-b42a-266e37195d18): created successfully Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2964158d-d366-489b-b7f6-1dc19f9ff937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Flow 'volume_create_manager' (507157fa-fcbf-4b82-b3a4-a69c13ef4bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:54 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-fc8018c7-4f80-456e-8bec-6ede90991bb6 tempest-VolumesImageMetadata-453785241 None] Created volume successfully. Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Flow 'volume_create_manager' (4b584a19-8162-40ea-8acd-d8b277b2b06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f305b8-8773-4068-bf43-36c56802f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f305b8-8773-4068-bf43-36c56802f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1952407620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce8c42f-40f4-433a-b16b-bcc02261d754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4410cd0cd5cf49188b4a3eeff7979f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:54Z,use_quota=True,user_id='42c7db6e3f964c8f8733414c9779f204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae43b4a-67e3-45dc-938e-3f10c8222748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae43b4a-67e3-45dc-938e-3f10c8222748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812be3ff-10c0-4135-8f25-3762b3e9e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812be3ff-10c0-4135-8f25-3762b3e9e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce8c42f-40f4-433a-b16b-bcc02261d754', 'volume_name': 'volume-9ce8c42f-40f4-433a-b16b-bcc02261d754', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc16e78d-8dd1-4bce-ab79-d8738d56356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc16e78d-8dd1-4bce-ab79-d8738d56356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988dfb93-67d0-40c5-a6c1-2a61cdd01fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Volume 9ce8c42f-40f4-433a-b16b-bcc02261d754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce8c42f-40f4-433a-b16b-bcc02261d754', 'volume_size': 1} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1952407620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce8c42f-40f4-433a-b16b-bcc02261d754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4410cd0cd5cf49188b4a3eeff7979f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:57:54Z,use_quota=True,user_id='42c7db6e3f964c8f8733414c9779f204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Creating volume 9ce8c42f-40f4-433a-b16b-bcc02261d754 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:57:54 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:57:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:54 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 1073741824 Apr 24 19:57:54 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:55 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 1073741824" returned: 0 in 0.823s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:55 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 Apr 24 19:57:55 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:55 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Acquiring lock "cinder-cc578848-fd46-4b96-b42a-266e37195d18-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:55 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Lock "cinder-cc578848-fd46-4b96-b42a-266e37195d18-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Acquiring lock "cinder-quobyte-cc578848-fd46-4b96-b42a-266e37195d18" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:56 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754" returned: 0 in 0.548s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988dfb93-67d0-40c5-a6c1-2a61cdd01fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce8c42f-40f4-433a-b16b-bcc02261d754', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a728cf-9a5e-4b3f-b3b5-4ffc3d0b3b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Lock "cinder-quobyte-cc578848-fd46-4b96-b42a-266e37195d18" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:56 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Volume volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 (9ce8c42f-40f4-433a-b16b-bcc02261d754): created successfully Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a728cf-9a5e-4b3f-b3b5-4ffc3d0b3b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Flow 'volume_create_manager' (4b584a19-8162-40ea-8acd-d8b277b2b06b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:57:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6b38bf0f-ec86-43c0-8013-e26b4b7331f1 tempest-VolumesTransfersV357Test-85888388 None] Created volume successfully. Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e83d0a-a57f-4789-9e6f-e135453b5fd7]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:56 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 Apr 24 19:57:56 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:56 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18" returned: 0 in 0.570s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:56 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 Apr 24 19:57:56 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:57 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18" returned: 1 in 0.595s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:57 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18 Apr 24 19:57:57 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:57 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-c239adb6-6a4d-4f3a-bac6-47aa94de4af0 tempest-VolumesTransfersV357Test-349846036 None] Transfer volume completed successfully. Apr 24 19:57:57 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-cc578848-fd46-4b96-b42a-266e37195d18" returned: 0 in 0.523s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Lock "cinder-quobyte-cc578848-fd46-4b96-b42a-266e37195d18" released by "delete_volume" :: held 1.755s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Created reservations ['eacec8fb-7331-4f73-a35d-01e6306144f9', 'a46a62e8-11fa-40fd-8e96-2c26b97a17a1', 'dc4b4166-e416-40ec-8a19-f7386212577e', '270c799e-d27d-4474-b5c8-571af3567fce'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:57:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:57 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:57:57 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:58 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.636s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:58 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:57:58 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Deleted volume successfully. Apr 24 19:57:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3d36c2e6-986b-4fc6-8e00-2a221224211e tempest-VolumesImageMetadata-453785241 None] Lock "cinder-cc578848-fd46-4b96-b42a-266e37195d18-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:57:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Acquiring lock "cinder-9ce8c42f-40f4-433a-b16b-bcc02261d754-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Lock "cinder-9ce8c42f-40f4-433a-b16b-bcc02261d754-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Acquiring lock "cinder-quobyte-9ce8c42f-40f4-433a-b16b-bcc02261d754" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:57:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Lock "cinder-quobyte-9ce8c42f-40f4-433a-b16b-bcc02261d754" acquired by "delete_volume" :: waited 0.012s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:57:58 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdb1439-bd38-438f-aa2a-83ebb145aff8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:57:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:58 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 Apr 24 19:57:58 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:59 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754" returned: 0 in 0.749s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:57:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:57:59 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754 Apr 24 19:57:59 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:57:59 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 24 19:57:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9ce8c42f-40f4-433a-b16b-bcc02261d754" returned: 0 in 0.506s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Lock "cinder-quobyte-9ce8c42f-40f4-433a-b16b-bcc02261d754" released by "delete_volume" :: held 1.301s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Created reservations ['aaee5f14-d636-4145-af6a-ee63bafba7bd', 'ad81df9a-cf12-4343-b5d8-ed45f5bd5523', 'bb951612-6570-4140-886a-7f514bd39436', '313a874b-e0b8-4bee-81f7-30be2cbb2d89'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:00 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:00 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:00 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.512s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:00 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Deleted volume successfully. Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77916dbb-d239-4548-b6e4-60fa53a3c100 tempest-VolumesTransfersV357Test-1416308863 None] Lock "cinder-9ce8c42f-40f4-433a-b16b-bcc02261d754-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Flow 'volume_create_manager' (2c8bca2b-8389-47a8-8098-f09f472531c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd5500f-6824-4c05-801e-3a0b6d326532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd5500f-6824-4c05-801e-3a0b6d326532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2135578937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8000dd24-a64a-451e-ae2f-89064c2a0e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17829978af464bf7b9388b92f8efa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:01Z,use_quota=True,user_id='405dd6fee8e14dc892fe130b84866980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb969f39-6f43-4adf-8f2b-15ddfe4bc66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb969f39-6f43-4adf-8f2b-15ddfe4bc66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3864ba49-ad97-4f69-af2a-83184d961f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3864ba49-ad97-4f69-af2a-83184d961f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8000dd24-a64a-451e-ae2f-89064c2a0e68', 'volume_name': 'volume-8000dd24-a64a-451e-ae2f-89064c2a0e68', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee482a0-f695-4823-8c3d-fcf273e194c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee482a0-f695-4823-8c3d-fcf273e194c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9afbe43-5d6c-410f-9cf3-abdb8f73cb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:00 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Volume 8000dd24-a64a-451e-ae2f-89064c2a0e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8000dd24-a64a-451e-ae2f-89064c2a0e68', 'volume_size': 1} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2135578937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8000dd24-a64a-451e-ae2f-89064c2a0e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17829978af464bf7b9388b92f8efa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:01Z,use_quota=True,user_id='405dd6fee8e14dc892fe130b84866980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Creating volume 8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:00 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:01 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 1073741824 Apr 24 19:58:01 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Flow 'volume_create_manager' (541ecb00-f7f2-4b40-a96a-cd8c2510b47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd92d47d-399b-423e-80bf-9e97f87e6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd92d47d-399b-423e-80bf-9e97f87e6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-373959110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8323dc-2a14-42ef-bf8b-797b77118256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4410cd0cd5cf49188b4a3eeff7979f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:01Z,use_quota=True,user_id='42c7db6e3f964c8f8733414c9779f204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51632893-35e1-47a5-91d4-7294230c839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51632893-35e1-47a5-91d4-7294230c839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25fb03cd-b352-44e4-95d2-2c717722978c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25fb03cd-b352-44e4-95d2-2c717722978c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8323dc-2a14-42ef-bf8b-797b77118256', 'volume_name': 'volume-3e8323dc-2a14-42ef-bf8b-797b77118256', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebf9ad5-ea65-4f1f-8ee1-9853f1ceddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebf9ad5-ea65-4f1f-8ee1-9853f1ceddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec673cd8-f0f5-4c46-8a01-ed06a9fd5dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:01 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Volume 3e8323dc-2a14-42ef-bf8b-797b77118256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8323dc-2a14-42ef-bf8b-797b77118256', 'volume_size': 1} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:01 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 1073741824" returned: 0 in 0.691s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:01 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 Apr 24 19:58:01 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:02 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68" returned: 0 in 0.439s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-373959110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8323dc-2a14-42ef-bf8b-797b77118256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4410cd0cd5cf49188b4a3eeff7979f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:01Z,use_quota=True,user_id='42c7db6e3f964c8f8733414c9779f204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Creating volume 3e8323dc-2a14-42ef-bf8b-797b77118256 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:02 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9afbe43-5d6c-410f-9cf3-abdb8f73cb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8000dd24-a64a-451e-ae2f-89064c2a0e68', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f05bd7-67f4-49ac-b0db-209555fc7227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:02 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256 1073741824 Apr 24 19:58:02 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:02 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Volume volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 (8000dd24-a64a-451e-ae2f-89064c2a0e68): created successfully Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f05bd7-67f4-49ac-b0db-209555fc7227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Flow 'volume_create_manager' (2c8bca2b-8389-47a8-8098-f09f472531c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4f1ac391-6c7b-4738-bf9e-c50b33020944 tempest-VolumesDeleteCascade-698708808 None] Created volume successfully. Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Flow 'volume_create_manager' (0e1a20c3-88db-4335-acb6-608def24912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1befedd-4957-4778-957b-aa8d72ad0dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1befedd-4957-4778-957b-aa8d72ad0dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2096275191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d53563c-0973-4112-b599-51e24d3efc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44097d85c9e24f5186d63a34b9c33168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:02Z,use_quota=True,user_id='eeb3bf72a4f34e84a3343321e6091c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66138913-4d15-47e2-b2c7-214ca43949a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66138913-4d15-47e2-b2c7-214ca43949a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ec0691-75ae-4ebb-84fd-9827d3780846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ec0691-75ae-4ebb-84fd-9827d3780846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d53563c-0973-4112-b599-51e24d3efc9e', 'volume_name': 'volume-0d53563c-0973-4112-b599-51e24d3efc9e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9713f8a2-8814-4110-9956-80a6f1cd1eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9713f8a2-8814-4110-9956-80a6f1cd1eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f03f8a-3783-4c41-8dba-af072d7596c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:02 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Volume 0d53563c-0973-4112-b599-51e24d3efc9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d53563c-0973-4112-b599-51e24d3efc9e', 'volume_size': 1} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:02 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256 1073741824" returned: 0 in 0.652s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:02 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256 Apr 24 19:58:02 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:03 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256" returned: 0 in 0.492s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.787s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2096275191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d53563c-0973-4112-b599-51e24d3efc9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44097d85c9e24f5186d63a34b9c33168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:02Z,use_quota=True,user_id='eeb3bf72a4f34e84a3343321e6091c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Creating volume 0d53563c-0973-4112-b599-51e24d3efc9e {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:03 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec673cd8-f0f5-4c46-8a01-ed06a9fd5dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8323dc-2a14-42ef-bf8b-797b77118256', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d4f716-5f61-4e6e-ad97-c928d79125cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:03 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e 1073741824 Apr 24 19:58:03 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:03 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Volume volume-3e8323dc-2a14-42ef-bf8b-797b77118256 (3e8323dc-2a14-42ef-bf8b-797b77118256): created successfully Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d4f716-5f61-4e6e-ad97-c928d79125cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Flow 'volume_create_manager' (541ecb00-f7f2-4b40-a96a-cd8c2510b47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:03 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-07a6af35-6214-402f-a46c-3729021b0a3e tempest-VolumesTransfersV357Test-85888388 None] Created volume successfully. Apr 24 19:58:03 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e 1073741824" returned: 0 in 0.611s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:04 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e Apr 24 19:58:04 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:04 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e" returned: 0 in 0.449s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.275s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f03f8a-3783-4c41-8dba-af072d7596c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d53563c-0973-4112-b599-51e24d3efc9e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c79a547-d15a-40eb-97e5-abcfc1abbfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:04 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Volume volume-0d53563c-0973-4112-b599-51e24d3efc9e (0d53563c-0973-4112-b599-51e24d3efc9e): created successfully Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c79a547-d15a-40eb-97e5-abcfc1abbfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Flow 'volume_create_manager' (0e1a20c3-88db-4335-acb6-608def24912e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Creating offline snapshot 7f1c27ec-da81-4528-929a-467db9d22137 of volume 8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:58:04 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-76efbd3a-e904-46fc-8198-afca8f2ad538 tempest-VolumesTransfersV355Test-480784190 None] Created volume successfully. Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec94f5c-d45a-4e15-805b-1e7bd0e2fef5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:04 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 Apr 24 19:58:04 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Acquiring lock "cinder-3e8323dc-2a14-42ef-bf8b-797b77118256-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Lock "cinder-3e8323dc-2a14-42ef-bf8b-797b77118256-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Acquiring lock "cinder-quobyte-3e8323dc-2a14-42ef-bf8b-797b77118256" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Lock "cinder-quobyte-3e8323dc-2a14-42ef-bf8b-797b77118256" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aa989b-f477-479c-ab5f-f5ca11389b22]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:04 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256 Apr 24 19:58:04 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:05 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68" returned: 0 in 0.669s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:05 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f1598ae9-f4ea-48bd-ad1f-75da34e34cbd tempest-VolumesTransfersV355Test-1578422665 None] Transfer volume completed successfully. Apr 24 19:58:05 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 1G Apr 24 19:58:05 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:05 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256" returned: 0 in 0.580s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:05 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256 Apr 24 19:58:05 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:05 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 1G" returned: 0 in 0.590s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:05 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 Apr 24 19:58:05 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:06 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3e8323dc-2a14-42ef-bf8b-797b77118256" returned: 0 in 0.503s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Lock "cinder-quobyte-3e8323dc-2a14-42ef-bf8b-797b77118256" released by "delete_volume" :: held 1.125s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Created reservations ['f37b2850-be24-456a-bf37-d73e49671309', 'c3d306c6-9e06-4883-9894-581b31fa13b2', 'e1ca2fb5-deed-4ab6-a310-21bb6de7f870', '7328ed3d-3d31-45cd-8c1c-11add645c079'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:06 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:06 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Acquiring lock "cinder-0d53563c-0973-4112-b599-51e24d3efc9e-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Lock "cinder-0d53563c-0973-4112-b599-51e24d3efc9e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Acquiring lock "cinder-quobyte-0d53563c-0973-4112-b599-51e24d3efc9e" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Lock "cinder-quobyte-0d53563c-0973-4112-b599-51e24d3efc9e" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ec2a0-46e9-4227-8c59-9277d42e710f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:06 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e Apr 24 19:58:06 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:06 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137" returned: 0 in 0.620s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:06 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 is being set with open permissions: ugo+rw Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:06 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 Apr 24 19:58:06 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:06 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.495s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:06 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Deleted volume successfully. Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d5a5dcb4-54f2-4efa-91dd-05ad6f45f045 tempest-VolumesTransfersV357Test-1416308863 None] Lock "cinder-3e8323dc-2a14-42ef-bf8b-797b77118256-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:06 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e" returned: 0 in 0.559s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:06 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e Apr 24 19:58:06 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:06 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137" returned: 0 in 0.498s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:06 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.info Apr 24 19:58:06 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:07 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0d53563c-0973-4112-b599-51e24d3efc9e" returned: 0 in 0.510s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Lock "cinder-quobyte-0d53563c-0973-4112-b599-51e24d3efc9e" released by "delete_volume" :: held 1.119s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Created reservations ['252ed1f7-82d0-44f0-81ac-0b7ede785031', '5c3cc128-e156-4da3-b33d-6ac1802283fd', 'cd5859c4-f892-4b33-b3d9-d9f5808b85a5', 'e123de81-d333-42d5-8ed4-ce67b97285a1'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:07 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.info" returned: 0 in 0.584s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:07 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.info is being set with open permissions: ugo+rw Apr 24 19:58:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:07 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:07 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:07 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.info Apr 24 19:58:07 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:07 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.462s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:08 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Deleted volume successfully. Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b3933478-8b82-4011-9fca-2bda41bd2d19 tempest-VolumesTransfersV355Test-1344012299 None] Lock "cinder-0d53563c-0973-4112-b599-51e24d3efc9e-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:08 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.info" returned: 0 in 0.495s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.587s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:08 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-43c9931d-3dfd-4e8b-83f8-0bbe77d62f4e tempest-VolumesDeleteCascade-698708808 None] Create snapshot completed successfully Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Creating offline snapshot 9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 of volume 8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c0cfa-6ffc-4499-b169-034d0ac82451]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:08 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 Apr 24 19:58:08 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Flow 'volume_create_manager' (569d45e4-7556-461e-a8dc-13c7641821a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbf6624-99a9-4b5a-9255-04ae395bae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbf6624-99a9-4b5a-9255-04ae395bae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-649488121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213f49a5-b032-463f-a31f-5df0e6ed6e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44097d85c9e24f5186d63a34b9c33168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:09Z,use_quota=True,user_id='eeb3bf72a4f34e84a3343321e6091c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63550772-7891-400d-85e5-c67694bb897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63550772-7891-400d-85e5-c67694bb897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc4b36b-ac40-42a1-9e62-ad05e369ed6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc4b36b-ac40-42a1-9e62-ad05e369ed6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213f49a5-b032-463f-a31f-5df0e6ed6e54', 'volume_name': 'volume-213f49a5-b032-463f-a31f-5df0e6ed6e54', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfa1c0f-286d-429c-a0fe-d448f5b995f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfa1c0f-286d-429c-a0fe-d448f5b995f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f55c4de-84fa-4b92-8196-82a6a5952bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:09 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Volume 213f49a5-b032-463f-a31f-5df0e6ed6e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213f49a5-b032-463f-a31f-5df0e6ed6e54', 'volume_size': 1} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:09 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137" returned: 0 in 0.678s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8000dd24-a64a-451e-ae2f-89064c2a0e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:09 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 1G Apr 24 19:58:09 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:10 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 1G" returned: 0 in 0.740s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:10 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 Apr 24 19:58:10 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:10 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69" returned: 0 in 0.497s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:10 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 is being set with open permissions: ugo+rw Apr 24 19:58:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:10 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 Apr 24 19:58:10 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:11 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69" returned: 0 in 0.495s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.069s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-649488121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213f49a5-b032-463f-a31f-5df0e6ed6e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44097d85c9e24f5186d63a34b9c33168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:09Z,use_quota=True,user_id='eeb3bf72a4f34e84a3343321e6091c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Creating volume 213f49a5-b032-463f-a31f-5df0e6ed6e54 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:11 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:11 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 1073741824 Apr 24 19:58:11 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:11 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-ddd3bcb6-25c7-49ff-87f2-12c23e067615 tempest-VolumesDeleteCascade-698708808 None] Create snapshot completed successfully Apr 24 19:58:11 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 1073741824" returned: 0 in 0.652s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-8000dd24-a64a-451e-ae2f-89064c2a0e68-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-8000dd24-a64a-451e-ae2f-89064c2a0e68-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:11 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 Apr 24 19:58:11 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Performing cascade delete. {{(pid=81641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-7f1c27ec-da81-4528-929a-467db9d22137-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-7f1c27ec-da81-4528-929a-467db9d22137-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-8000dd24-a64a-451e-ae2f-89064c2a0e68" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8000dd24-a64a-451e-ae2f-89064c2a0e68" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-7f1c27ec-da81-4528-929a-467db9d22137" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-7f1c27ec-da81-4528-929a-467db9d22137" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Deleting offline snapshot 7f1c27ec-da81-4528-929a-467db9d22137 of volume 8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:58:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] snapshot_file for this snap is: volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f51bac-bba6-43c4-a6c0-5fe5fe3ecd3a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:12 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 Apr 24 19:58:12 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Flow 'volume_create_manager' (70fdfaf7-9587-4569-9b23-4833054cb109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5d1499-cde8-43da-aba7-4e76e4a673df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5d1499-cde8-43da-aba7-4e76e4a673df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-903809569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf95785-b72d-45f2-809e-5e9dc1067c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c570542afe75422d90ea7ec1b1d49792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:12Z,use_quota=True,user_id='2dbc374e447e4f33934a40c81951b743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4826f9-4ca0-4837-a7ed-2fa7f4d66686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4826f9-4ca0-4837-a7ed-2fa7f4d66686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0236617-e1c2-4e74-b819-d41b353684dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0236617-e1c2-4e74-b819-d41b353684dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cf95785-b72d-45f2-809e-5e9dc1067c39', 'volume_name': 'volume-5cf95785-b72d-45f2-809e-5e9dc1067c39', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c54e42-3b5b-424f-97a4-4df815265bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c54e42-3b5b-424f-97a4-4df815265bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0c00a2-ea13-4d3d-b9c2-c74e21494a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:12 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:12 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Volume 5cf95785-b72d-45f2-809e-5e9dc1067c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cf95785-b72d-45f2-809e-5e9dc1067c39', 'volume_size': 1} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54" returned: 0 in 0.511s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-903809569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf95785-b72d-45f2-809e-5e9dc1067c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c570542afe75422d90ea7ec1b1d49792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:12Z,use_quota=True,user_id='2dbc374e447e4f33934a40c81951b743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Creating volume 5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:12 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f55c4de-84fa-4b92-8196-82a6a5952bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213f49a5-b032-463f-a31f-5df0e6ed6e54', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfd8be3-b150-4e4a-b630-79e823480b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:12 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 1073741824 Apr 24 19:58:12 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:12 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Volume volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 (213f49a5-b032-463f-a31f-5df0e6ed6e54): created successfully Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfd8be3-b150-4e4a-b630-79e823480b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Flow 'volume_create_manager' (569d45e4-7556-461e-a8dc-13c7641821a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:12 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a9d4bc0c-852f-43e0-a0a7-474579f2cd2b tempest-VolumesTransfersV355Test-480784190 None] Created volume successfully. Apr 24 19:58:12 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137" returned: 0 in 0.581s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8000dd24-a64a-451e-ae2f-89064c2a0e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dfa425-621b-46b2-9cd1-f65476001f38]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:12 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 Apr 24 19:58:12 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:13 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 1073741824" returned: 0 in 0.694s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:13 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 Apr 24 19:58:13 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:13 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68" returned: 0 in 0.580s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f08f52d-27dd-4c32-9b3d-83b2b0b4c358]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:13 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 Apr 24 19:58:13 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Acquiring lock "cinder-213f49a5-b032-463f-a31f-5df0e6ed6e54-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Lock "cinder-213f49a5-b032-463f-a31f-5df0e6ed6e54-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Acquiring lock "cinder-quobyte-213f49a5-b032-463f-a31f-5df0e6ed6e54" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Lock "cinder-quobyte-213f49a5-b032-463f-a31f-5df0e6ed6e54" acquired by "delete_volume" :: waited 0.014s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e572f8ba-53fb-4d69-b061-d2f4be7b4323]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:13 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39" returned: 0 in 0.487s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0c00a2-ea13-4d3d-b9c2-c74e21494a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cf95785-b72d-45f2-809e-5e9dc1067c39', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e97a18-9f22-40ab-ade2-e2258a58b277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:13 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Volume volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 (5cf95785-b72d-45f2-809e-5e9dc1067c39): created successfully Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e97a18-9f22-40ab-ade2-e2258a58b277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Flow 'volume_create_manager' (70fdfaf7-9587-4569-9b23-4833054cb109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:13 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1992ab44-0046-48b4-bc09-011616921458 tempest-VolumesCloneTest-1670803700 None] Created volume successfully. Apr 24 19:58:13 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 Apr 24 19:58:13 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:13 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69" returned: 0 in 0.578s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8000dd24-a64a-451e-ae2f-89064c2a0e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecbc8e2-8c8a-4f3e-b5f8-601f2ae394e7]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:13 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 Apr 24 19:58:13 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:14 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54" returned: 0 in 0.537s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:14 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54 Apr 24 19:58:14 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:14 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137" returned: 0 in 0.542s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8000dd24-a64a-451e-ae2f-89064c2a0e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b365d-c9e6-4c48-ad4d-06406cfb5368]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:14 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 Apr 24 19:58:14 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:14 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-213f49a5-b032-463f-a31f-5df0e6ed6e54" returned: 0 in 0.433s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Lock "cinder-quobyte-213f49a5-b032-463f-a31f-5df0e6ed6e54" released by "delete_volume" :: held 1.014s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Created reservations ['7d9c75de-3008-4e06-80da-a36a166fb1a8', 'feaa2345-82db-4680-b2b1-4d0269620a8d', '2a19a720-1f1b-4432-84ab-c5cf990e8846', '19c91266-9420-4065-88b4-a4f010f48385'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:14 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:14 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Flow 'volume_create_manager' (ee896afe-7680-4066-8821-369317d44c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0788c5-4844-4be3-becd-54a802920eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0788c5-4844-4be3-becd-54a802920eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-236406474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9e29e4-b287-4a5d-a8ad-e0b29f577b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c570542afe75422d90ea7ec1b1d49792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5cf95785-b72d-45f2-809e-5e9dc1067c39,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:15Z,use_quota=True,user_id='2dbc374e447e4f33934a40c81951b743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d392983-3112-46aa-808b-3b560bd9fbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d392983-3112-46aa-808b-3b560bd9fbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6d9c0d-e6c6-49c8-9d2e-b6195bf8ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6d9c0d-e6c6-49c8-9d2e-b6195bf8ea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bf9e29e4-b287-4a5d-a8ad-e0b29f577b55', 'volume_name': 'volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55', 'volume_size': 2, 'source_volid': '5cf95785-b72d-45f2-809e-5e9dc1067c39', 'source_volstatus': 'available'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2bb3a9-a504-4512-9200-4e572326d9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2bb3a9-a504-4512-9200-4e572326d9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90dafba-56b5-46c0-8601-83d2b9ed5584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:14 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Volume bf9e29e4-b287-4a5d-a8ad-e0b29f577b55: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55', 'volume_size': 2, 'source_volid': '5cf95785-b72d-45f2-809e-5e9dc1067c39', 'source_volstatus': 'available'} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:14 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Cloning volume 5cf95785-b72d-45f2-809e-5e9dc1067c39 to volume bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Creating offline snapshot ec69b4b0-a3e8-414c-9448-e5df73dc42b8 of volume 5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[993e5e35-4d33-4c57-8132-4cd4f3916a41]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:14 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 Apr 24 19:58:14 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:15 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68" returned: 0 in 0.657s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:15 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 Apr 24 19:58:15 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:15 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.477s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:15 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:15 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Deleted volume successfully. Apr 24 19:58:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d9e57345-901b-4505-800a-c5ee33033512 tempest-VolumesTransfersV355Test-1344012299 None] Lock "cinder-213f49a5-b032-463f-a31f-5df0e6ed6e54-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:15 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39" returned: 0 in 0.524s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:15 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 1G Apr 24 19:58:15 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:15 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137" returned: 0 in 0.533s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:15 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137 Apr 24 19:58:15 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:16 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 1G" returned: 0 in 0.695s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:16 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 Apr 24 19:58:16 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:16 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.7f1c27ec-da81-4528-929a-467db9d22137" returned: 0 in 0.542s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 -F qcow2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:16 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 -F qcow2 Apr 24 19:58:16 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:16 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8" returned: 0 in 0.504s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:16 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 is being set with open permissions: ugo+rw Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:16 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 Apr 24 19:58:16 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:16 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 -F qcow2" returned: 0 in 0.534s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-7f1c27ec-da81-4528-929a-467db9d22137" released by "_delete_snapshot" :: held 4.741s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8000dd24-a64a-451e-ae2f-89064c2a0e68" released by "delete_snapshot" :: held 4.777s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Created reservations ['48acc498-aa07-4b59-b685-0daa83e808c9', 'db21dd40-b853-4c9c-8c51-e13f680f04a6', '1c5666da-8472-4703-b509-75fc44b19d54', 'f4ae1a92-55ed-4e1e-b532-6ced0cc20480'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:16 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Delete snapshot completed successfully. Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-7f1c27ec-da81-4528-929a-467db9d22137-delete_snapshot" released by "delete_snapshot" :: held 4.997s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-8000dd24-a64a-451e-ae2f-89064c2a0e68" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8000dd24-a64a-451e-ae2f-89064c2a0e68" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Deleting offline snapshot 9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 of volume 8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] snapshot_file for this snap is: volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eac9e99-fef4-4d3f-a740-91c01fd848ed]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:17 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 Apr 24 19:58:17 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:17 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8" returned: 0 in 0.551s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:17 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.info Apr 24 19:58:17 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:17 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69" returned: 0 in 0.627s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8000dd24-a64a-451e-ae2f-89064c2a0e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[de436c8b-cd84-44fb-8023-eb5551e8eeb2]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:17 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.info" returned: 0 in 0.541s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:17 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.info is being set with open permissions: ugo+rw Apr 24 19:58:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:17 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 Apr 24 19:58:17 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:17 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.info Apr 24 19:58:17 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:18 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.info" returned: 0 in 0.518s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Acquiring lock "cinder-quobyte-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Lock "cinder-quobyte-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] snapshot: ec69b4b0-a3e8-414c-9448-e5df73dc42b8, volume: bf9e29e4-b287-4a5d-a8ad-e0b29f577b55, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6196e0-fee0-4669-90cb-a2d1e2fb6248]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:18 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68" returned: 0 in 0.684s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:18 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 Apr 24 19:58:18 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:18 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 Apr 24 19:58:18 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:18 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8" returned: 0 in 0.619s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cf95785-b72d-45f2-809e-5e9dc1067c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0dfed8-a41e-4edb-91d2-94d4cf9cb0f0]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:19 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69" returned: 0 in 0.656s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:19 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69 Apr 24 19:58:19 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:19 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 Apr 24 19:58:19 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:19 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68.9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69" returned: 0 in 0.519s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:19 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69" released by "_delete_snapshot" :: held 2.594s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39" returned: 0 in 0.604s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8000dd24-a64a-451e-ae2f-89064c2a0e68" released by "delete_snapshot" :: held 2.636s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:19 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 Apr 24 19:58:19 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Created reservations ['ab0da245-e39b-48b8-8254-fd2cba6c7824', '8b9340ab-bc83-4985-b9ff-2ea626a89dca', '851f6cbf-3c0e-43bc-9c3a-0200e81844ce', '00aa06f1-f092-4fa1-adb3-1e6f8ed866ec'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:19 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Delete snapshot completed successfully. Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-9f28f1a4-ddd4-4ef7-8bee-87f6cda5db69-delete_snapshot" released by "delete_snapshot" :: held 2.790s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Snapshots deleted, issuing volume delete {{(pid=81641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-8000dd24-a64a-451e-ae2f-89064c2a0e68" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8000dd24-a64a-451e-ae2f-89064c2a0e68" acquired by "delete_volume" :: waited 0.012s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9dd8d1-b3d7-4276-9099-7c8060407edb]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:19 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 Apr 24 19:58:19 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:20 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68" returned: 0 in 0.858s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:20 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68 Apr 24 19:58:20 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Flow 'volume_create_manager' (12a64270-fd04-474d-b975-ebb0305dc4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5139d57d-2636-4c32-97d1-bd07380d6ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5139d57d-2636-4c32-97d1-bd07380d6ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-997040145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0624fc6-f794-4771-a957-f36c45960fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcef4c5f1b3f481a9311727ff5ffb363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:22Z,use_quota=True,user_id='64d049c3d1ae4945b66929ec2a7215e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53057d63-4384-400e-ae65-edf8d93bbcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53057d63-4384-400e-ae65-edf8d93bbcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016ea38a-c171-4b3e-bdcd-e72e8272b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016ea38a-c171-4b3e-bdcd-e72e8272b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0624fc6-f794-4771-a957-f36c45960fee', 'volume_name': 'volume-f0624fc6-f794-4771-a957-f36c45960fee', 'volume_size': 2}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78e9d5d-6400-4587-b648-1f8d041fdb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78e9d5d-6400-4587-b648-1f8d041fdb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f486bb-3d9f-4d37-8b11-a4b076188aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:21 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:21 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Volume f0624fc6-f794-4771-a957-f36c45960fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0624fc6-f794-4771-a957-f36c45960fee', 'volume_size': 2} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8000dd24-a64a-451e-ae2f-89064c2a0e68" returned: 0 in 1.254s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8000dd24-a64a-451e-ae2f-89064c2a0e68" released by "delete_volume" :: held 2.198s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:21 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Created reservations ['e0ea2daa-24da-4172-97d4-501aeedf72f1', 'd34b5edd-9557-440d-89fd-8ad658e89072', '5e9c4790-f2c7-415c-8c93-069650a51b4f', '82481321-6ab0-43eb-8e37-a97cd477df01'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:22 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:22 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:23 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.173s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:23 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:23 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Deleted volume successfully. Apr 24 19:58:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f43649a8-eff2-40be-b1c4-7389ad67017e tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-8000dd24-a64a-451e-ae2f-89064c2a0e68-delete_volume" released by "delete_volume" :: held 11.521s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:23 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Flow 'volume_create_manager' (c924e479-e545-4712-b480-1260839da3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18042a5-ecf7-470b-a375-724a9d43248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18042a5-ecf7-470b-a375-724a9d43248b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1841041895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ec4d15-32fb-4ec5-a17c-a364bfa33e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17829978af464bf7b9388b92f8efa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:24Z,use_quota=True,user_id='405dd6fee8e14dc892fe130b84866980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6550e65-a9a0-4ea7-982e-b3b04451d3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6550e65-a9a0-4ea7-982e-b3b04451d3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f77834-7a27-4e24-b269-34a8185d660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f77834-7a27-4e24-b269-34a8185d660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ec4d15-32fb-4ec5-a17c-a364bfa33e08', 'volume_name': 'volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cfedcb-e572-4a43-b440-270229da6ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cfedcb-e572-4a43-b440-270229da6ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbbc4c1-8515-4ba4-a9ef-badd56927812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:24 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Volume 35ec4d15-32fb-4ec5-a17c-a364bfa33e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08', 'volume_size': 1} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:24 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" returned: 0 in 5.388s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b009094-57d6-4d30-9421-bb1d018a58b5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:25 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 Apr 24 19:58:25 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:25 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39" returned: 0 in 0.626s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:25 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:58:25 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Converted 1024.00 MB image at 190.00 MB/s Apr 24 19:58:25 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 is being set with open permissions: ugo+rw Apr 24 19:58:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:25 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 Apr 24 19:58:25 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:26 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" returned: 0 in 0.456s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Lock "cinder-quobyte-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" released by "_copy_volume_from_snapshot" :: held 7.781s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Acquiring lock "cinder-quobyte-ec69b4b0-a3e8-414c-9448-e5df73dc42b8" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Lock "cinder-quobyte-ec69b4b0-a3e8-414c-9448-e5df73dc42b8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Deleting offline snapshot ec69b4b0-a3e8-414c-9448-e5df73dc42b8 of volume 5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] snapshot_file for this snap is: volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e89a76c-a7b6-4336-b29a-2c60dbdf287e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:26 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 Apr 24 19:58:26 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:26 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8" returned: 0 in 0.531s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cf95785-b72d-45f2-809e-5e9dc1067c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[add96c6a-a6b9-4530-a0c6-480d327c6bdc]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:26 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 Apr 24 19:58:26 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:27 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39" returned: 0 in 0.527s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:27 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 Apr 24 19:58:27 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:27 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8" returned: 0 in 0.519s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:27 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8 Apr 24 19:58:27 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:28 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39.ec69b4b0-a3e8-414c-9448-e5df73dc42b8" returned: 0 in 0.455s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Lock "cinder-quobyte-ec69b4b0-a3e8-414c-9448-e5df73dc42b8" released by "_delete_snapshot" :: held 2.120s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.410s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.377s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-997040145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0624fc6-f794-4771-a957-f36c45960fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcef4c5f1b3f481a9311727ff5ffb363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:22Z,use_quota=True,user_id='64d049c3d1ae4945b66929ec2a7215e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Creating volume f0624fc6-f794-4771-a957-f36c45960fee {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:28 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee 2147483648 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:28 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee 2147483648 Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90dafba-56b5-46c0-8601-83d2b9ed5584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55', 'volume_size': 2, 'source_volid': '5cf95785-b72d-45f2-809e-5e9dc1067c39', 'source_volstatus': 'available'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:28 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8ef8bd-5987-4f26-bc34-b12f23956cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:28 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Volume volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 (bf9e29e4-b287-4a5d-a8ad-e0b29f577b55): created successfully Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8ef8bd-5987-4f26-bc34-b12f23956cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Flow 'volume_create_manager' (ee896afe-7680-4066-8821-369317d44c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:28 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b70dbf07-28bf-40af-83af-a2d57c124cd3 tempest-VolumesCloneTest-1670803700 None] Created volume successfully. Apr 24 19:58:28 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee 2147483648" returned: 0 in 0.621s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:28 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee Apr 24 19:58:28 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Acquiring lock "cinder-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Lock "cinder-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Acquiring lock "cinder-quobyte-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Lock "cinder-quobyte-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deed8c6-de61-48cd-a006-7eac64db008c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:29 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 Apr 24 19:58:29 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:29 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee" returned: 0 in 0.462s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.227s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1841041895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ec4d15-32fb-4ec5-a17c-a364bfa33e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17829978af464bf7b9388b92f8efa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:24Z,use_quota=True,user_id='405dd6fee8e14dc892fe130b84866980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Creating volume 35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:29 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f486bb-3d9f-4d37-8b11-a4b076188aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0624fc6-f794-4771-a957-f36c45960fee', 'volume_size': 2}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:29 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 1073741824 Apr 24 19:58:29 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afafc69e-249f-47e3-884a-3c01d5d35c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:29 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Volume volume-f0624fc6-f794-4771-a957-f36c45960fee (f0624fc6-f794-4771-a957-f36c45960fee): created successfully Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afafc69e-249f-47e3-884a-3c01d5d35c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Flow 'volume_create_manager' (12a64270-fd04-474d-b975-ebb0305dc4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:29 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5ce3af76-a2b1-4d1c-84d9-6042cf6c5f22 tempest-VolumesCloneNegativeTest-643473504 None] Created volume successfully. Apr 24 19:58:29 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" returned: 0 in 0.502s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:29 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55 Apr 24 19:58:29 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:29 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 1073741824" returned: 0 in 0.581s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:30 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 Apr 24 19:58:30 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:30 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" returned: 0 in 0.485s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Lock "cinder-quobyte-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55" released by "delete_volume" :: held 1.025s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Created reservations ['20d75b31-a69a-42b1-85f1-f2605fb3bf76', '8a58e8e2-c96f-42ee-aa8d-31d36fa2c48a', '0273c0c9-b639-40b2-9743-35f9d69c682e', '7d816875-8dd8-45a3-acd1-77be0d533226'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:30 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:30 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Acquiring lock "cinder-f0624fc6-f794-4771-a957-f36c45960fee-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Lock "cinder-f0624fc6-f794-4771-a957-f36c45960fee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Acquiring lock "cinder-quobyte-f0624fc6-f794-4771-a957-f36c45960fee" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Lock "cinder-quobyte-f0624fc6-f794-4771-a957-f36c45960fee" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:30 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" returned: 0 in 0.505s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb2436-839f-46c4-9e0b-08a3fe6940b5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbbc4c1-8515-4ba4-a9ef-badd56927812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02885f7-10aa-4136-b27e-831c57ead334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:30 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Volume volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 (35ec4d15-32fb-4ec5-a17c-a364bfa33e08): created successfully Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02885f7-10aa-4136-b27e-831c57ead334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Flow 'volume_create_manager' (c924e479-e545-4712-b480-1260839da3d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e174c3c4-4915-44be-822d-e35c4592b437 tempest-VolumesDeleteCascade-698708808 None] Created volume successfully. Apr 24 19:58:30 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee Apr 24 19:58:30 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:30 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.501s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Deleted volume successfully. Apr 24 19:58:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f527f90c-ada9-4956-844d-4044c2af3646 tempest-VolumesCloneTest-1670803700 None] Lock "cinder-bf9e29e4-b287-4a5d-a8ad-e0b29f577b55-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:31 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee" returned: 0 in 0.550s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:31 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee Apr 24 19:58:31 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Creating offline snapshot 6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 of volume 35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[34792d77-81de-407e-9383-e3c5afe2459f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Acquiring lock "cinder-5cf95785-b72d-45f2-809e-5e9dc1067c39-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Lock "cinder-5cf95785-b72d-45f2-809e-5e9dc1067c39-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:31 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 Apr 24 19:58:31 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Acquiring lock "cinder-quobyte-5cf95785-b72d-45f2-809e-5e9dc1067c39" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Lock "cinder-quobyte-5cf95785-b72d-45f2-809e-5e9dc1067c39" acquired by "delete_volume" :: waited 0.027s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b36d70-e6ad-475c-8b91-c12cdd0fc7d9]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:31 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f0624fc6-f794-4771-a957-f36c45960fee" returned: 0 in 0.502s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Lock "cinder-quobyte-f0624fc6-f794-4771-a957-f36c45960fee" released by "delete_volume" :: held 1.099s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:31 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 Apr 24 19:58:31 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Created reservations ['27e56915-c6a8-4244-bb3e-1a8fdb345b18', 'f50b009e-22c1-4b02-bf5b-0db4647b4752', 'eb88ad95-f5b7-444c-a2c6-d3144bde5ba7', '4b739f9a-f35e-4ca3-a0f8-9c244608ede0'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:31 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:31 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:31 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" returned: 0 in 0.586s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:32 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 1G Apr 24 19:58:32 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:32 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39" returned: 0 in 0.580s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:32 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39 Apr 24 19:58:32 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:32 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.490s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:32 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Deleted volume successfully. Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdcb4db2-854d-45c1-b324-0d975459f647 tempest-VolumesCloneNegativeTest-643473504 None] Lock "cinder-f0624fc6-f794-4771-a957-f36c45960fee-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:32 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 1G" returned: 0 in 0.627s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:32 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 Apr 24 19:58:32 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:32 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5cf95785-b72d-45f2-809e-5e9dc1067c39" returned: 0 in 0.500s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Lock "cinder-quobyte-5cf95785-b72d-45f2-809e-5e9dc1067c39" released by "delete_volume" :: held 1.133s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Created reservations ['8ff6a047-d278-4250-8708-e7e8714996ea', 'cf6e6c7a-508a-4550-91cf-1fead48b213c', 'e20abbe4-ea0a-4da0-888e-c2166ecc2a93', '744a85a6-4538-4b75-9f84-e4da651c17d8'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:32 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:32 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:33 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43" returned: 0 in 0.573s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:33 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 is being set with open permissions: ugo+rw Apr 24 19:58:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:33 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 Apr 24 19:58:33 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:33 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.531s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:33 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:33 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Deleted volume successfully. Apr 24 19:58:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-67634618-c6c9-4c77-a4f8-2e7724585b5c tempest-VolumesCloneTest-1670803700 None] Lock "cinder-5cf95785-b72d-45f2-809e-5e9dc1067c39-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:33 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43" returned: 0 in 0.582s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:33 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.info Apr 24 19:58:33 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:34 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.info" returned: 0 in 0.550s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:34 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.info is being set with open permissions: ugo+rw Apr 24 19:58:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:34 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.info Apr 24 19:58:34 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:34 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.info" returned: 0 in 0.591s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.603s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:34 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-85876236-22fd-475b-8816-917a8acab273 tempest-VolumesDeleteCascade-698708808 None] Create snapshot completed successfully Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (d52dd774-3dbc-4e1f-b610-1fdf12f4ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cbd2a6-1469-4a3b-a82d-5808a8e45490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cbd2a6-1469-4a3b-a82d-5808a8e45490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1438503778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed888504-82bd-4919-8c01-6f7734068589,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:35Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2813db96-51dd-4a17-af7c-7cfc9f72c5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2813db96-51dd-4a17-af7c-7cfc9f72c5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e5a464-0572-4440-a75f-4a16d814db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e5a464-0572-4440-a75f-4a16d814db44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed888504-82bd-4919-8c01-6f7734068589', 'volume_name': 'volume-ed888504-82bd-4919-8c01-6f7734068589', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa69194-2b4f-444e-9060-96fcda0e4657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa69194-2b4f-444e-9060-96fcda0e4657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812a6b49-581b-4f5d-a3e4-955417d0a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:35 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Volume ed888504-82bd-4919-8c01-6f7734068589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed888504-82bd-4919-8c01-6f7734068589', 'volume_size': 1} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1438503778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed888504-82bd-4919-8c01-6f7734068589,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:35Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Creating volume ed888504-82bd-4919-8c01-6f7734068589 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:35 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:35 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589 1073741824 Apr 24 19:58:35 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:35 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Flow 'volume_create_manager' (1eec91e1-0b81-448f-a8b9-9169ae9f06e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06719dbd-32ce-41d1-8e11-09e883d1d342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06719dbd-32ce-41d1-8e11-09e883d1d342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-174254065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9ee59c-b64a-4ada-89ae-9f7f3acec79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17829978af464bf7b9388b92f8efa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6c0323ab-e129-439b-9c7c-dc0aa5cbfe43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:36Z,use_quota=True,user_id='405dd6fee8e14dc892fe130b84866980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e79d8eb-6634-4c1c-bb48-a7a1465093d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e79d8eb-6634-4c1c-bb48-a7a1465093d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33afdc0-3084-4cba-9365-a257bc567650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33afdc0-3084-4cba-9365-a257bc567650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b9ee59c-b64a-4ada-89ae-9f7f3acec79a', 'volume_name': 'volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a', 'volume_size': 1, 'snapshot_id': '6c0323ab-e129-439b-9c7c-dc0aa5cbfe43'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82693d2-be93-4cb7-8d0f-3eae519d07bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82693d2-be93-4cb7-8d0f-3eae519d07bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f220fffc-b2a5-4afa-b2d9-269f935aafa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Volume 8b9ee59c-b64a-4ada-89ae-9f7f3acec79a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a', 'volume_size': 1, 'snapshot_id': '6c0323ab-e129-439b-9c7c-dc0aa5cbfe43'} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:36 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589 1073741824" returned: 0 in 0.677s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:36 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589 Apr 24 19:58:36 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Flow 'volume_create_manager' (b970ad27-f8ae-4454-9ba0-352cfe9b2f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf18adbb-8d19-4378-9f2c-f25b09da4276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf18adbb-8d19-4378-9f2c-f25b09da4276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1139355938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb286350-1521-4fd6-991f-8795ae4d02d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff5d158522cb45a08d06b7a9c3eeee03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:36Z,use_quota=True,user_id='d40136bc71d3461ba6c18666aa74f710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ddb867-2bdd-4717-8b92-1498e6c1c72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ddb867-2bdd-4717-8b92-1498e6c1c72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935119a5-6df4-451d-a8c4-9f9f372f2703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935119a5-6df4-451d-a8c4-9f9f372f2703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb286350-1521-4fd6-991f-8795ae4d02d1', 'volume_name': 'volume-fb286350-1521-4fd6-991f-8795ae4d02d1', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f32e914-1e4a-4d1d-8cd6-a23e73019660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f32e914-1e4a-4d1d-8cd6-a23e73019660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18287385-5a2a-4aa0-811d-12dc885f3e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Volume fb286350-1521-4fd6-991f-8795ae4d02d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb286350-1521-4fd6-991f-8795ae4d02d1', 'volume_size': 1} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:36 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589" returned: 0 in 0.500s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.572s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-6c0323ab-e129-439b-9c7c-dc0aa5cbfe43-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" by "_create_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812a6b49-581b-4f5d-a3e4-955417d0a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed888504-82bd-4919-8c01-6f7734068589', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d73965-295c-4c80-9e3e-1da7338a6155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-6c0323ab-e129-439b-9c7c-dc0aa5cbfe43-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Creating volume 8b9ee59c-b64a-4ada-89ae-9f7f3acec79a from snapshot 6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 {{(pid=81641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:36 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Volume volume-ed888504-82bd-4919-8c01-6f7734068589 (ed888504-82bd-4919-8c01-6f7734068589): created successfully Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d73965-295c-4c80-9e3e-1da7338a6155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (d52dd774-3dbc-4e1f-b610-1fdf12f4ad48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] snapshot: 6c0323ab-e129-439b-9c7c-dc0aa5cbfe43, volume: 8b9ee59c-b64a-4ada-89ae-9f7f3acec79a, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:58:36 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6893fd76-303b-422c-8817-997c6383ca09 tempest-VolumesGetTest-1502477854 None] Created volume successfully. Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec08c4af-261e-4d65-b0a3-8d32adfd2e8a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:36 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 Apr 24 19:58:36 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:37 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43" returned: 0 in 0.532s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:58:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:58:37 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff67ae-9bbd-499b-843e-aa09ecd52a29]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:37 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 Apr 24 19:58:37 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:37 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" returned: 0 in 0.575s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:37 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:58:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:37 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a Apr 24 19:58:37 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (e9fbcbf6-df32-406a-8412-8e053ffc4ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8a6e48-f9cf-4b63-8f97-fec51b75fcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8a6e48-f9cf-4b63-8f97-fec51b75fcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-346028806',display_name='tempest-VolumesGetTest-Volume-335212097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43cdb21-e38d-4a4a-85c1-d4f00b489b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:38Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e76ee0f-c7fb-4c59-84ac-cc09fa21bac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e76ee0f-c7fb-4c59-84ac-cc09fa21bac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5862740-a4da-4b7b-a25f-ce814005e919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5862740-a4da-4b7b-a25f-ce814005e919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43cdb21-e38d-4a4a-85c1-d4f00b489b64', 'volume_name': 'volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be572c8-88ae-493a-aa80-8ac9c8181779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be572c8-88ae-493a-aa80-8ac9c8181779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3982e6fa-2d3a-41d7-8328-ac0f3426fdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:38 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Volume b43cdb21-e38d-4a4a-85c1-d4f00b489b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64', 'volume_size': 1} Apr 24 19:58:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:42 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" returned: 0 in 4.324s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:42 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af6a7b4-71d8-4314-8bf2-a48a4cb9e43c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:42 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 Apr 24 19:58:42 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:42 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" returned: 0 in 0.603s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:42 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08, size 1024.00 MB, duration 4.32 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:58:42 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Converted 1024.00 MB image at 236.78 MB/s Apr 24 19:58:42 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a is being set with open permissions: ugo+rw Apr 24 19:58:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:42 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a Apr 24 19:58:42 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:43 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" returned: 0 in 0.410s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" released by "_copy_volume_from_snapshot" :: held 6.536s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-6c0323ab-e129-439b-9c7c-dc0aa5cbfe43-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" released by "_create_volume_from_snapshot" :: held 6.574s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.601s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.750s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1139355938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb286350-1521-4fd6-991f-8795ae4d02d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff5d158522cb45a08d06b7a9c3eeee03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:36Z,use_quota=True,user_id='d40136bc71d3461ba6c18666aa74f710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Creating volume fb286350-1521-4fd6-991f-8795ae4d02d1 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:43 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:43 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1 1073741824 Apr 24 19:58:43 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f220fffc-b2a5-4afa-b2d9-269f935aafa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a', 'volume_size': 1, 'snapshot_id': '6c0323ab-e129-439b-9c7c-dc0aa5cbfe43'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152886b0-6457-451d-be35-d8bd7bf22f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:43 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Volume volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a (8b9ee59c-b64a-4ada-89ae-9f7f3acec79a): created successfully Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152886b0-6457-451d-be35-d8bd7bf22f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Flow 'volume_create_manager' (1eec91e1-0b81-448f-a8b9-9169ae9f06e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:43 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-60c4b627-7257-4ef1-bd95-f607c34fb3e6 tempest-VolumesDeleteCascade-698708808 None] Created volume successfully. Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-35ec4d15-32fb-4ec5-a17c-a364bfa33e08-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-35ec4d15-32fb-4ec5-a17c-a364bfa33e08-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Performing cascade delete. {{(pid=81641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-6c0323ab-e129-439b-9c7c-dc0aa5cbfe43-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-6c0323ab-e129-439b-9c7c-dc0aa5cbfe43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-6c0323ab-e129-439b-9c7c-dc0aa5cbfe43" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-6c0323ab-e129-439b-9c7c-dc0aa5cbfe43" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Deleting offline snapshot 6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 of volume 35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] snapshot_file for this snap is: volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded72521-0556-4c59-b8a0-bff4ef8368b8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:43 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 Apr 24 19:58:43 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:43 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1 1073741824" returned: 0 in 0.633s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:43 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1 Apr 24 19:58:43 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:44 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43" returned: 0 in 0.530s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[03432f02-6dca-4b7b-a59f-e98b1d3bad37]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:44 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1" returned: 0 in 0.448s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.179s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-346028806',display_name='tempest-VolumesGetTest-Volume-335212097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43cdb21-e38d-4a4a-85c1-d4f00b489b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:38Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Creating volume b43cdb21-e38d-4a4a-85c1-d4f00b489b64 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:44 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18287385-5a2a-4aa0-811d-12dc885f3e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb286350-1521-4fd6-991f-8795ae4d02d1', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:44 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 1073741824 Apr 24 19:58:44 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e05b90-7168-474d-bace-9150cc198abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:44 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Volume volume-fb286350-1521-4fd6-991f-8795ae4d02d1 (fb286350-1521-4fd6-991f-8795ae4d02d1): created successfully Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e05b90-7168-474d-bace-9150cc198abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Flow 'volume_create_manager' (b970ad27-f8ae-4454-9ba0-352cfe9b2f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:44 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 Apr 24 19:58:44 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:44 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-abfc7d86-aebe-4faa-8f5e-0119a0219950 tempest-VolumesListTestJSON-650926105 None] Created volume successfully. Apr 24 19:58:44 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" returned: 0 in 0.543s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:44 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 Apr 24 19:58:44 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:45 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 1073741824" returned: 0 in 0.613s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:45 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 Apr 24 19:58:45 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Flow 'volume_create_manager' (73222308-bcb2-416f-9d7b-1299b65c2a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7715ed2c-5ca8-4ae4-a34b-2dd9245dba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7715ed2c-5ca8-4ae4-a34b-2dd9245dba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1921051622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90d53b6-66ff-4375-b16f-ddec504e178d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff5d158522cb45a08d06b7a9c3eeee03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:45Z,use_quota=True,user_id='d40136bc71d3461ba6c18666aa74f710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:45 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ee04ed-059d-4859-b504-15cf87f747e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ee04ed-059d-4859-b504-15cf87f747e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92762b9b-53d7-41d6-b2ac-f4f6e8437c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92762b9b-53d7-41d6-b2ac-f4f6e8437c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90d53b6-66ff-4375-b16f-ddec504e178d', 'volume_name': 'volume-d90d53b6-66ff-4375-b16f-ddec504e178d', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebde487-0ba3-4740-87cb-3e31a87a6c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebde487-0ba3-4740-87cb-3e31a87a6c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:45 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe1d3ce-c8c1-424e-af61-fe8303623602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Volume d90d53b6-66ff-4375-b16f-ddec504e178d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90d53b6-66ff-4375-b16f-ddec504e178d', 'volume_size': 1} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64" returned: 0 in 0.492s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43" returned: 0 in 0.643s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1921051622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90d53b6-66ff-4375-b16f-ddec504e178d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff5d158522cb45a08d06b7a9c3eeee03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:45Z,use_quota=True,user_id='d40136bc71d3461ba6c18666aa74f710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Creating volume d90d53b6-66ff-4375-b16f-ddec504e178d {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:45 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43 Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:45 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:45 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3982e6fa-2d3a-41d7-8328-ac0f3426fdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:45 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d 1073741824 Apr 24 19:58:45 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644a2907-ca8e-499b-ac67-0ea1f2a128ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Volume volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 (b43cdb21-e38d-4a4a-85c1-d4f00b489b64): created successfully Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644a2907-ca8e-499b-ac67-0ea1f2a128ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (e9fbcbf6-df32-406a-8412-8e053ffc4ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:45 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e1cd4a02-d493-4509-bc6c-7c9cac1e6736 tempest-VolumesGetTest-1502477854 None] Created volume successfully. Apr 24 19:58:46 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08.6c0323ab-e129-439b-9c7c-dc0aa5cbfe43" returned: 0 in 0.466s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-6c0323ab-e129-439b-9c7c-dc0aa5cbfe43" released by "_delete_snapshot" :: held 2.280s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" released by "delete_snapshot" :: held 2.303s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Created reservations ['516dd9ff-5183-4841-bf50-b94bbaf3c63b', 'dbf0314d-6250-464e-aa30-b1082cba6f76', '3580eb67-66d7-48b5-8d47-8bde8858e569', '18c46ec2-c9fb-4d9c-accc-62d5b823ad73'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:46 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Delete snapshot completed successfully. Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-6c0323ab-e129-439b-9c7c-dc0aa5cbfe43-delete_snapshot" released by "delete_snapshot" :: held 2.442s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Snapshots deleted, issuing volume delete {{(pid=81641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[00110ede-ed7c-46c6-98f6-7ebde42905e9]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:46 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d 1073741824" returned: 0 in 0.675s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:46 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 Apr 24 19:58:46 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:46 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d Apr 24 19:58:46 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:46 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d" returned: 0 in 0.443s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:46 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" returned: 0 in 0.516s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe1d3ce-c8c1-424e-af61-fe8303623602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90d53b6-66ff-4375-b16f-ddec504e178d', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0139bb-32bb-4001-8fd4-80617bccc50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:46 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08 Apr 24 19:58:46 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:46 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Volume volume-d90d53b6-66ff-4375-b16f-ddec504e178d (d90d53b6-66ff-4375-b16f-ddec504e178d): created successfully Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0139bb-32bb-4001-8fd4-80617bccc50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Flow 'volume_create_manager' (73222308-bcb2-416f-9d7b-1299b65c2a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:46 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e0858d55-759f-4fb0-b4cb-00bf3fefbabd tempest-VolumesListTestJSON-650926105 None] Created volume successfully. Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-b43cdb21-e38d-4a4a-85c1-d4f00b489b64-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Lock "cinder-b43cdb21-e38d-4a4a-85c1-d4f00b489b64-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-quobyte-b43cdb21-e38d-4a4a-85c1-d4f00b489b64" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-b43cdb21-e38d-4a4a-85c1-d4f00b489b64" acquired by "delete_volume" :: waited 0.012s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d50cef7-23b2-4c35-a325-8241455d32be]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:47 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 Apr 24 19:58:47 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:47 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" returned: 0 in 0.492s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-35ec4d15-32fb-4ec5-a17c-a364bfa33e08" released by "delete_volume" :: held 1.063s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Created reservations ['602c27cf-acc9-4903-9787-ab0310ed0738', '8b37a6fa-e51a-40ca-86f6-9bde8b81cbd1', 'f2046642-c336-42f1-9767-8a7ffdb38281', '91e32e5c-3b61-4f42-bb0d-c86693e5e858'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:47 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:47 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:47 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64" returned: 0 in 0.500s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:47 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64 Apr 24 19:58:47 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:47 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.492s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:47 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Deleted volume successfully. Apr 24 19:58:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44ad672e-2779-433c-b7bf-4d7c6c10b181 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-35ec4d15-32fb-4ec5-a17c-a364bfa33e08-delete_volume" released by "delete_volume" :: held 4.248s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Flow 'volume_create_manager' (c707ff6e-1253-4c98-b1f8-94637259a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831fbf28-280b-4c9a-a373-0a84f6844a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:48 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b43cdb21-e38d-4a4a-85c1-d4f00b489b64" returned: 0 in 0.531s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831fbf28-280b-4c9a-a373-0a84f6844a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1687039046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15f568b-4b5d-4133-a356-6598b77d6f9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff5d158522cb45a08d06b7a9c3eeee03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:48Z,use_quota=True,user_id='d40136bc71d3461ba6c18666aa74f710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46554b66-45ac-4578-9d88-8f9004099144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46554b66-45ac-4578-9d88-8f9004099144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcdea2f-97c2-4aea-a742-313221a1967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcdea2f-97c2-4aea-a742-313221a1967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15f568b-4b5d-4133-a356-6598b77d6f9b', 'volume_name': 'volume-d15f568b-4b5d-4133-a356-6598b77d6f9b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8d3964-920f-4a75-b3cc-3622f9b272b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8d3964-920f-4a75-b3cc-3622f9b272b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b53fa0-07dd-443e-9f3d-913cb5b9843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:48 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Volume d15f568b-4b5d-4133-a356-6598b77d6f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15f568b-4b5d-4133-a356-6598b77d6f9b', 'volume_size': 1} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1687039046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15f568b-4b5d-4133-a356-6598b77d6f9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff5d158522cb45a08d06b7a9c3eeee03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:48Z,use_quota=True,user_id='d40136bc71d3461ba6c18666aa74f710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Creating volume d15f568b-4b5d-4133-a356-6598b77d6f9b {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:48 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-b43cdb21-e38d-4a4a-85c1-d4f00b489b64" released by "delete_volume" :: held 1.134s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:48 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b 1073741824 Apr 24 19:58:48 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Created reservations ['a7ea631e-3f72-4c27-9c3c-09997b0bdd15', 'fdfab053-e5dd-4f8a-8b73-8cdc3145ef59', '20adb6d2-e8a0-4e89-944d-2319ee55cf69', 'd1146580-11b2-4c08-9b33-b469be002ce9'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "cinder-quobyte-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd3e76-c19c-4b3c-924d-93e0ea99a851]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:48 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:48 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:48 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a Apr 24 19:58:48 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:48 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b 1073741824" returned: 0 in 0.605s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:48 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b Apr 24 19:58:48 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:48 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.477s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:48 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Deleted volume successfully. Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7e554dae-4cc6-458d-84cd-cd5a6c040ac9 tempest-VolumesGetTest-1502477854 None] Lock "cinder-b43cdb21-e38d-4a4a-85c1-d4f00b489b64-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:48 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" returned: 0 in 0.562s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:48 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a Apr 24 19:58:48 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-ed888504-82bd-4919-8c01-6f7734068589-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Lock "cinder-ed888504-82bd-4919-8c01-6f7734068589-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-quobyte-ed888504-82bd-4919-8c01-6f7734068589" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:49 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b" returned: 0 in 0.546s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b53fa0-07dd-443e-9f3d-913cb5b9843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15f568b-4b5d-4133-a356-6598b77d6f9b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fa1171-8ae3-4e11-88bc-6d38adaa903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-ed888504-82bd-4919-8c01-6f7734068589" acquired by "delete_volume" :: waited 0.029s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:49 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Volume volume-d15f568b-4b5d-4133-a356-6598b77d6f9b (d15f568b-4b5d-4133-a356-6598b77d6f9b): created successfully Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fa1171-8ae3-4e11-88bc-6d38adaa903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Flow 'volume_create_manager' (c707ff6e-1253-4c98-b1f8-94637259a60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f5dc21-d848-4975-a7fe-e4a9d7822245]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:49 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" returned: 0 in 0.539s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:49 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6329ae82-fa04-4748-8857-de06bdba188f tempest-VolumesListTestJSON-650926105 None] Created volume successfully. Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-quobyte-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a" released by "delete_volume" :: held 1.148s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:49 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589 Apr 24 19:58:49 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Created reservations ['f4457fa0-89be-46cd-ba45-5650bd9a81ef', '3817ee62-88b9-41a1-a86e-ef73ca83a8e8', '21812771-0197-4f64-b203-4b1c9f0ee441', '7f00fac1-6a81-44c9-b9ed-9ebc61b24d36'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:49 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:49 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:49 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589" returned: 0 in 0.534s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:49 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589 Apr 24 19:58:49 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:49 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.432s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:49 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:50 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Deleted volume successfully. Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-35e7bd69-7509-4391-bff9-8f52a3541fe6 tempest-VolumesDeleteCascade-698708808 None] Lock "cinder-8b9ee59c-b64a-4ada-89ae-9f7f3acec79a-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:50 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ed888504-82bd-4919-8c01-6f7734068589" returned: 0 in 0.445s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-ed888504-82bd-4919-8c01-6f7734068589" released by "delete_volume" :: held 1.032s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Created reservations ['c46f142d-e25f-43e5-aee8-14c5b01298e4', '0008494b-cd3d-4972-9730-897ce8b0970d', '9b959697-11c1-4a04-bf0f-8608099e6b88', 'f5980879-bd8c-49ef-9093-e6db5498c0aa'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:50 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:50 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:51 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.541s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:51 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Deleted volume successfully. Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5423a32a-9525-4767-9389-6ab8d3a5d167 tempest-VolumesGetTest-1502477854 None] Lock "cinder-ed888504-82bd-4919-8c01-6f7734068589-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (64437310-797c-493c-9d8e-842238a4fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb7441a-50dc-4278-abc6-1d7b58d48f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb7441a-50dc-4278-abc6-1d7b58d48f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-931545375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456329d0-3f99-469b-96fd-c80153aa3178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:52Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d6b0ca-2e50-4d1a-864f-d4b28179becc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d6b0ca-2e50-4d1a-864f-d4b28179becc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ad5337-e129-408e-88ca-c918bba4474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ad5337-e129-408e-88ca-c918bba4474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456329d0-3f99-469b-96fd-c80153aa3178', 'volume_name': 'volume-456329d0-3f99-469b-96fd-c80153aa3178', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d612e0-f8e2-4b13-a47e-01ecf59f85af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d612e0-f8e2-4b13-a47e-01ecf59f85af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1a430e-a04a-4c4f-a5e4-e7b34b85ea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:51 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Volume 456329d0-3f99-469b-96fd-c80153aa3178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456329d0-3f99-469b-96fd-c80153aa3178', 'volume_size': 1} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-931545375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456329d0-3f99-469b-96fd-c80153aa3178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:52Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Creating volume 456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:51 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:51 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 1073741824 Apr 24 19:58:51 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Acquiring lock "cinder-d15f568b-4b5d-4133-a356-6598b77d6f9b-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Lock "cinder-d15f568b-4b5d-4133-a356-6598b77d6f9b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Acquiring lock "cinder-quobyte-d15f568b-4b5d-4133-a356-6598b77d6f9b" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Lock "cinder-quobyte-d15f568b-4b5d-4133-a356-6598b77d6f9b" acquired by "delete_volume" :: waited 0.014s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce00ab2e-5836-4875-b2a7-3933b710f7b2]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:52 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b Apr 24 19:58:52 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:52 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 1073741824" returned: 0 in 0.647s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:52 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 Apr 24 19:58:52 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:52 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b" returned: 0 in 0.625s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:52 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b Apr 24 19:58:52 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:53 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178" returned: 0 in 0.480s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:53 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:53 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1a430e-a04a-4c4f-a5e4-e7b34b85ea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456329d0-3f99-469b-96fd-c80153aa3178', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecdad4d-eb33-4b78-acae-f002fef7f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:53 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Volume volume-456329d0-3f99-469b-96fd-c80153aa3178 (456329d0-3f99-469b-96fd-c80153aa3178): created successfully Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecdad4d-eb33-4b78-acae-f002fef7f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (64437310-797c-493c-9d8e-842238a4fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:53 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-46e83080-aca1-42e5-9fda-e0fac76c90a2 tempest-VolumesGetTest-1502477854 None] Created volume successfully. Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Flow 'volume_create_manager' (ad30f999-a4e8-48e0-9977-eef2df13c5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534346e2-7b12-43b0-ac1d-ea1e0dd9cee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534346e2-7b12-43b0-ac1d-ea1e0dd9cee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-619168632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9b49d5-3458-4152-ad02-ac5897149fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e606aa9942484eed92b32c524fba7702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:53Z,use_quota=True,user_id='2f94fec51ac241f19f049a3bd9e85114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebecc5ea-6222-4ea5-84d5-ad0a60f88603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebecc5ea-6222-4ea5-84d5-ad0a60f88603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378cd7b3-f898-4bb0-bfd6-3da2e9880100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378cd7b3-f898-4bb0-bfd6-3da2e9880100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9b49d5-3458-4152-ad02-ac5897149fd4', 'volume_name': 'volume-4a9b49d5-3458-4152-ad02-ac5897149fd4', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4edac1-55e5-4987-9f39-df9fcd7e2cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4edac1-55e5-4987-9f39-df9fcd7e2cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d91d708-0205-4835-a796-ac85c26b1ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:53 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Volume 4a9b49d5-3458-4152-ad02-ac5897149fd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9b49d5-3458-4152-ad02-ac5897149fd4', 'volume_size': 1} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-619168632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9b49d5-3458-4152-ad02-ac5897149fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e606aa9942484eed92b32c524fba7702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:53Z,use_quota=True,user_id='2f94fec51ac241f19f049a3bd9e85114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Creating volume 4a9b49d5-3458-4152-ad02-ac5897149fd4 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:58:53 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:53 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 1073741824 Apr 24 19:58:53 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:53 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d15f568b-4b5d-4133-a356-6598b77d6f9b" returned: 0 in 0.497s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Lock "cinder-quobyte-d15f568b-4b5d-4133-a356-6598b77d6f9b" released by "delete_volume" :: held 1.165s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Created reservations ['6da1db9e-88ee-4e30-9434-d8b9c29611a5', '30e25e1a-571d-4eb1-b8f6-1feed0425775', 'c1ae901c-7b80-4c51-b73b-481a48e8a281', '5ac02f2e-6c9a-4d50-a89d-1005d6e37329'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:53 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:53 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:53 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.523s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:54 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.474s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:54 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Deleted volume successfully. Apr 24 19:58:54 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 1073741824" returned: 0 in 0.663s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9335a215-89a1-42e2-a502-459a91eb67af tempest-VolumesListTestJSON-650926105 None] Lock "cinder-d15f568b-4b5d-4133-a356-6598b77d6f9b-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:54 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 Apr 24 19:58:54 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=135,cinder:INSERT=53,cinder:UPDATE=190,cinder:DELETE=15 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=147,cinder:INSERT=47,cinder:UPDATE=180,cinder:DELETE=19 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (e8af3081-a858-4b54-acc3-956bb8769b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71591dff-413b-4050-ab81-e1de4603995c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71591dff-413b-4050-ab81-e1de4603995c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1329462502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd2456f-1304-46ae-be9f-233a41a6a365,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=456329d0-3f99-469b-96fd-c80153aa3178,status='creating',terminated_at=None,updated_at=2026-04-24T17:58:54Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c09be9a-b2e5-4010-acb1-1a32fcef8414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c09be9a-b2e5-4010-acb1-1a32fcef8414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e5c379-1a1a-4764-bf69-9fa35fb686d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Acquiring lock "cinder-d90d53b6-66ff-4375-b16f-ddec504e178d-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e5c379-1a1a-4764-bf69-9fa35fb686d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ecd2456f-1304-46ae-be9f-233a41a6a365', 'volume_name': 'volume-ecd2456f-1304-46ae-be9f-233a41a6a365', 'volume_size': 1, 'source_volid': '456329d0-3f99-469b-96fd-c80153aa3178', 'source_volstatus': 'available'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141a8194-7d68-4336-8718-e9fac20f8d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141a8194-7d68-4336-8718-e9fac20f8d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a838e834-23e7-4026-bf6d-a5578c3c9d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Volume ecd2456f-1304-46ae-be9f-233a41a6a365: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ecd2456f-1304-46ae-be9f-233a41a6a365', 'volume_size': 1, 'source_volid': '456329d0-3f99-469b-96fd-c80153aa3178', 'source_volstatus': 'available'} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Lock "cinder-d90d53b6-66ff-4375-b16f-ddec504e178d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Acquiring lock "cinder-quobyte-d90d53b6-66ff-4375-b16f-ddec504e178d" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Lock "cinder-quobyte-d90d53b6-66ff-4375-b16f-ddec504e178d" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c073b9-b262-41a1-9545-a402056284f8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:54 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4" returned: 0 in 0.533s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.089s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:54 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Cloning volume 456329d0-3f99-469b-96fd-c80153aa3178 to volume ecd2456f-1304-46ae-be9f-233a41a6a365 Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d91d708-0205-4835-a796-ac85c26b1ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9b49d5-3458-4152-ad02-ac5897149fd4', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a862e85-d4d6-43e1-8e12-f0d454ee599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:58:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Volume volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 (4a9b49d5-3458-4152-ad02-ac5897149fd4): created successfully Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a862e85-d4d6-43e1-8e12-f0d454ee599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Flow 'volume_create_manager' (ad30f999-a4e8-48e0-9977-eef2df13c5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:58:54 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d Apr 24 19:58:54 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:54 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-110fa639-e2e6-48e8-93de-f600177c1227 tempest-VolumesMetadataTest-1754704370 None] Created volume successfully. Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Creating offline snapshot 2269956b-018b-4ef1-b830-37432ddd9d70 of volume 456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[088dc493-6566-48b0-b79d-42ac4b26d648]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:54 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 Apr 24 19:58:54 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:55 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d" returned: 0 in 0.489s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:55 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d Apr 24 19:58:55 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:55 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178" returned: 0 in 0.503s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:55 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 1G Apr 24 19:58:55 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:55 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d90d53b6-66ff-4375-b16f-ddec504e178d" returned: 0 in 0.515s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Lock "cinder-quobyte-d90d53b6-66ff-4375-b16f-ddec504e178d" released by "delete_volume" :: held 1.046s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Created reservations ['5938f37f-4272-4bf6-baca-ec20216a04d6', '77236129-a9ed-47f8-a6ba-c7a350a53a4d', '452fb043-1bfd-494e-872c-f56dfb92f03e', 'c1d32ef3-e37b-4fe6-a8d3-cf866f309852'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:55 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:55 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:55 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 1G" returned: 0 in 0.720s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456329d0-3f99-469b-96fd-c80153aa3178 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:55 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456329d0-3f99-469b-96fd-c80153aa3178 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 Apr 24 19:58:55 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Acquiring lock "cinder-4a9b49d5-3458-4152-ad02-ac5897149fd4-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Lock "cinder-4a9b49d5-3458-4152-ad02-ac5897149fd4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Acquiring lock "cinder-quobyte-4a9b49d5-3458-4152-ad02-ac5897149fd4" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Lock "cinder-quobyte-4a9b49d5-3458-4152-ad02-ac5897149fd4" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eaa094-b1e2-4050-ba0f-06c2cc78b50b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:56 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.555s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:56 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 Apr 24 19:58:56 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Deleted volume successfully. Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-72f08d55-aa08-4893-86bd-ed3e9c4f21dc tempest-VolumesListTestJSON-650926105 None] Lock "cinder-d90d53b6-66ff-4375-b16f-ddec504e178d-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:56 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456329d0-3f99-469b-96fd-c80153aa3178 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70" returned: 0 in 0.559s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:56 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 is being set with open permissions: ugo+rw Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:56 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 Apr 24 19:58:56 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Acquiring lock "cinder-fb286350-1521-4fd6-991f-8795ae4d02d1-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Lock "cinder-fb286350-1521-4fd6-991f-8795ae4d02d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Acquiring lock "cinder-quobyte-fb286350-1521-4fd6-991f-8795ae4d02d1" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Lock "cinder-quobyte-fb286350-1521-4fd6-991f-8795ae4d02d1" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:56 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4" returned: 0 in 0.567s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[061f7cb2-f5ed-4329-b654-6b117fccc01b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:56 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4 Apr 24 19:58:56 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:56 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1 Apr 24 19:58:56 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:57 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70" returned: 0 in 0.506s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:57 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.info Apr 24 19:58:57 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:57 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a9b49d5-3458-4152-ad02-ac5897149fd4" returned: 0 in 0.442s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Lock "cinder-quobyte-4a9b49d5-3458-4152-ad02-ac5897149fd4" released by "delete_volume" :: held 1.049s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Created reservations ['c072cfa6-436c-40e0-9938-66ccbe458433', 'badc69dc-dcd3-4581-a6f9-3b5240f14b95', '325a6b14-9b2b-42a8-b435-c047e93c159b', 'ed886438-eb11-40c7-af77-3683bd6949bd'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:57 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1" returned: 0 in 0.564s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:57 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1 Apr 24 19:58:57 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:57 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:57 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:57 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.info" returned: 0 in 0.510s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:57 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.info is being set with open permissions: ugo+rw Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:57 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.info Apr 24 19:58:57 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:57 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.503s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:57 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Deleted volume successfully. Apr 24 19:58:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-22bdd5de-f764-41e6-b2aa-75e0b2c94992 tempest-VolumesMetadataTest-1754704370 None] Lock "cinder-4a9b49d5-3458-4152-ad02-ac5897149fd4-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:58 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fb286350-1521-4fd6-991f-8795ae4d02d1" returned: 0 in 0.596s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Lock "cinder-quobyte-fb286350-1521-4fd6-991f-8795ae4d02d1" released by "delete_volume" :: held 1.208s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:58 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.info" returned: 0 in 0.503s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-quobyte-ecd2456f-1304-46ae-be9f-233a41a6a365" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-ecd2456f-1304-46ae-be9f-233a41a6a365" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] snapshot: 2269956b-018b-4ef1-b830-37432ddd9d70, volume: ecd2456f-1304-46ae-be9f-233a41a6a365, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fea9e0-a3d8-4a58-b986-9ff6569f7be3]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Created reservations ['692b815d-1ff7-4d8d-b742-ad97c105ecb9', '7edd7bf5-6238-482b-a389-1f642f0ed443', 'fdaba08c-db8d-4e5a-8175-6413d5bfc15a', '6de1738b-29ef-434c-9ff1-835c0d6b1b82'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:58:58 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 Apr 24 19:58:58 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:58 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:58:58 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:58 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.449s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:58:58 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Deleted volume successfully. Apr 24 19:58:58 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70" returned: 0 in 0.563s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456329d0-3f99-469b-96fd-c80153aa3178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-226dc5f1-23cf-4ccf-b9a6-8c8d67ce3263 tempest-VolumesListTestJSON-650926105 None] Lock "cinder-fb286350-1521-4fd6-991f-8795ae4d02d1-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30aad7d-2d74-4f98-b8cf-48044284cfb8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:58:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:58 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 Apr 24 19:58:58 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:58:59 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 24 19:58:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178" returned: 0 in 0.734s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:58:59 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:58:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:58:59 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 Apr 24 19:58:59 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Flow 'volume_create_manager' (5738a128-ba66-4e6d-9ba5-96b631f91bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d241e52-7cc9-4cfb-b2aa-0e2b6741ef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d241e52-7cc9-4cfb-b2aa-0e2b6741ef63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1704960864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e40ec4c-f864-4f56-9ab6-767436024a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bec4d55dc54731b7947c4bc8a7630e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:04Z,use_quota=True,user_id='18917f94f5f14db596833a5d4f547c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515239ff-64d5-4779-8ce3-aacaa42d12f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515239ff-64d5-4779-8ce3-aacaa42d12f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47af2cc-a02f-41f9-b404-aabfa87e20db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47af2cc-a02f-41f9-b404-aabfa87e20db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e40ec4c-f864-4f56-9ab6-767436024a90', 'volume_name': 'volume-8e40ec4c-f864-4f56-9ab6-767436024a90', 'volume_size': 2}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448eb7a8-f730-4fad-b3a5-c7f16438ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448eb7a8-f730-4fad-b3a5-c7f16438ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8406aa96-800a-4ba5-a880-bbc79821238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:03 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Volume 8e40ec4c-f864-4f56-9ab6-767436024a90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e40ec4c-f864-4f56-9ab6-767436024a90', 'volume_size': 2} Apr 24 19:59:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Flow 'volume_create_manager' (a987174b-e5aa-4528-9686-8b631c6400fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bb4e61-446d-4c0c-8448-c3278fa1bee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bb4e61-446d-4c0c-8448-c3278fa1bee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1709564459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ca4221-44a4-4097-ada8-2cc204e66fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccc6bc1467543eea4dc3eaae90ad9df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:05Z,use_quota=True,user_id='2886393f65334cf18a281fb53142da9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73443048-53df-4e21-bf59-7a3837daf8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73443048-53df-4e21-bf59-7a3837daf8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b606ef2-1c7a-4b6f-83f2-1f5f34fcea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b606ef2-1c7a-4b6f-83f2-1f5f34fcea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ca4221-44a4-4097-ada8-2cc204e66fc3', 'volume_name': 'volume-75ca4221-44a4-4097-ada8-2cc204e66fc3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc752a87-c9aa-4f9e-8f8f-8fe190a8382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc752a87-c9aa-4f9e-8f8f-8fe190a8382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bb0520-f04a-4399-bba8-414fa1c1a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:04 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Volume 75ca4221-44a4-4097-ada8-2cc204e66fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ca4221-44a4-4097-ada8-2cc204e66fc3', 'volume_size': 1} Apr 24 19:59:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:05 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365" returned: 0 in 5.774s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:05 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eaa7f8-623a-46b0-b912-de95814107a6]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:05 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 Apr 24 19:59:05 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:05 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178" returned: 0 in 0.639s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:05 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:59:05 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Converted 1024.00 MB image at 177.31 MB/s Apr 24 19:59:05 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 is being set with open permissions: ugo+rw Apr 24 19:59:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:05 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 Apr 24 19:59:05 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:06 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365" returned: 0 in 0.426s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-ecd2456f-1304-46ae-be9f-233a41a6a365" released by "_copy_volume_from_snapshot" :: held 8.216s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-quobyte-2269956b-018b-4ef1-b830-37432ddd9d70" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-2269956b-018b-4ef1-b830-37432ddd9d70" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Deleting offline snapshot 2269956b-018b-4ef1-b830-37432ddd9d70 of volume 456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] snapshot_file for this snap is: volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f287c610-c51f-43b2-bb59-719ed4290fe9]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:06 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 Apr 24 19:59:06 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:06 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70" returned: 0 in 0.516s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456329d0-3f99-469b-96fd-c80153aa3178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9691b2-8043-4785-84c3-eccfa9117f07]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:06 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 Apr 24 19:59:06 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:07 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178" returned: 0 in 0.481s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:07 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 Apr 24 19:59:07 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:07 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70" returned: 0 in 0.529s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:07 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70 Apr 24 19:59:07 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:08 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178.2269956b-018b-4ef1-b830-37432ddd9d70" returned: 0 in 0.429s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-2269956b-018b-4ef1-b830-37432ddd9d70" released by "_delete_snapshot" :: held 2.049s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.781s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.605s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1704960864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e40ec4c-f864-4f56-9ab6-767436024a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bec4d55dc54731b7947c4bc8a7630e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:04Z,use_quota=True,user_id='18917f94f5f14db596833a5d4f547c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Creating volume 8e40ec4c-f864-4f56-9ab6-767436024a90 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:08 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 2147483648 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a838e834-23e7-4026-bf6d-a5578c3c9d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd2456f-1304-46ae-be9f-233a41a6a365', 'volume_size': 1, 'source_volid': '456329d0-3f99-469b-96fd-c80153aa3178', 'source_volstatus': 'available'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:08 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 2147483648 Apr 24 19:59:08 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc3ca78-a719-4ff5-8f92-58dda68e4974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:08 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Volume volume-ecd2456f-1304-46ae-be9f-233a41a6a365 (ecd2456f-1304-46ae-be9f-233a41a6a365): created successfully Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc3ca78-a719-4ff5-8f92-58dda68e4974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:08 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (e8af3081-a858-4b54-acc3-956bb8769b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:08 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a725c937-be67-4b13-bd98-1a2fa1b53bcc tempest-VolumesGetTest-1502477854 None] Created volume successfully. Apr 24 19:59:09 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 2147483648" returned: 0 in 0.711s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:09 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 Apr 24 19:59:09 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (b155ffcd-ff07-4fe2-b050-5649392c222b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff46f904-f493-4310-ad4e-0d2a492af414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff46f904-f493-4310-ad4e-0d2a492af414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1756887178',display_name='tempest-VolumesGetTest-Volume-1974984390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b693115-1d2c-4de5-8e40-337152b33716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:09Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a50d561-7ea2-478a-ba87-550e41ab1141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a50d561-7ea2-478a-ba87-550e41ab1141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab7969e-2427-4ddc-80e3-4e66e379f852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab7969e-2427-4ddc-80e3-4e66e379f852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b693115-1d2c-4de5-8e40-337152b33716', 'volume_name': 'volume-5b693115-1d2c-4de5-8e40-337152b33716', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38eef16d-d330-4090-8a83-c7c8381a064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38eef16d-d330-4090-8a83-c7c8381a064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40901fb-95ff-480b-8e6a-921ecdff72f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:09 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Volume 5b693115-1d2c-4de5-8e40-337152b33716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b693115-1d2c-4de5-8e40-337152b33716', 'volume_size': 1} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:09 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90" returned: 0 in 0.410s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.641s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1709564459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ca4221-44a4-4097-ada8-2cc204e66fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccc6bc1467543eea4dc3eaae90ad9df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:05Z,use_quota=True,user_id='2886393f65334cf18a281fb53142da9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Creating volume 75ca4221-44a4-4097-ada8-2cc204e66fc3 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:09 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:09 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 1073741824 Apr 24 19:59:09 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8406aa96-800a-4ba5-a880-bbc79821238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e40ec4c-f864-4f56-9ab6-767436024a90', 'volume_size': 2}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94f3965-08c9-4ac4-b415-a2388a020f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:09 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Volume volume-8e40ec4c-f864-4f56-9ab6-767436024a90 (8e40ec4c-f864-4f56-9ab6-767436024a90): created successfully Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94f3965-08c9-4ac4-b415-a2388a020f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:09 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Flow 'volume_create_manager' (5738a128-ba66-4e6d-9ba5-96b631f91bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:09 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-734e65b6-b3f7-4a2a-a3ab-20ff6348ed1c tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Created volume successfully. Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:10 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 1073741824" returned: 0 in 0.656s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:10 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 Apr 24 19:59:10 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:10 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3" returned: 0 in 0.398s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1756887178',display_name='tempest-VolumesGetTest-Volume-1974984390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b693115-1d2c-4de5-8e40-337152b33716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:09Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Creating volume 5b693115-1d2c-4de5-8e40-337152b33716 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:10 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:10 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716 1073741824 Apr 24 19:59:10 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bb0520-f04a-4399-bba8-414fa1c1a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ca4221-44a4-4097-ada8-2cc204e66fc3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6eea31-4b68-4f41-affe-60d3764b226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:10 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Volume volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 (75ca4221-44a4-4097-ada8-2cc204e66fc3): created successfully Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6eea31-4b68-4f41-affe-60d3764b226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Flow 'volume_create_manager' (a987174b-e5aa-4528-9686-8b631c6400fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-56612264-7b67-4838-95b3-4a5a3747f98b tempest-VolumesTransfersTest-1968484789 None] Created volume successfully. Apr 24 19:59:11 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716 1073741824" returned: 0 in 0.623s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:11 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716 Apr 24 19:59:11 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:11 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-28fc2257-bc11-4c22-813f-13021b0e5f1b tempest-VolumesTransfersTest-1657426233 None] Transfer volume completed successfully. Apr 24 19:59:11 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716" returned: 0 in 0.484s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.623s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Creating offline snapshot 08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 of volume 8e40ec4c-f864-4f56-9ab6-767436024a90 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40901fb-95ff-480b-8e6a-921ecdff72f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b693115-1d2c-4de5-8e40-337152b33716', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975d363c-7ccc-4cbf-abc0-f1681edb63dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7deb62-c03e-4442-924e-a81ee62928ac]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:11 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Volume volume-5b693115-1d2c-4de5-8e40-337152b33716 (5b693115-1d2c-4de5-8e40-337152b33716): created successfully Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975d363c-7ccc-4cbf-abc0-f1681edb63dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (b155ffcd-ff07-4fe2-b050-5649392c222b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:11 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7045b3d2-4c19-4212-8737-0d03945ca4e6 tempest-VolumesGetTest-1502477854 None] Created volume successfully. Apr 24 19:59:11 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 Apr 24 19:59:11 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:12 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90" returned: 0 in 0.558s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 2G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:12 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 2G Apr 24 19:59:12 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-5b693115-1d2c-4de5-8e40-337152b33716-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Lock "cinder-5b693115-1d2c-4de5-8e40-337152b33716-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-quobyte-5b693115-1d2c-4de5-8e40-337152b33716" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-5b693115-1d2c-4de5-8e40-337152b33716" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f806e90e-9a7e-4e67-b177-4c57dc0a650f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Acquiring lock "cinder-75ca4221-44a4-4097-ada8-2cc204e66fc3-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Lock "cinder-75ca4221-44a4-4097-ada8-2cc204e66fc3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Acquiring lock "cinder-quobyte-75ca4221-44a4-4097-ada8-2cc204e66fc3" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:12 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716 Apr 24 19:59:12 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Lock "cinder-quobyte-75ca4221-44a4-4097-ada8-2cc204e66fc3" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[34153eee-c54c-475f-831a-55cf1d5d1cef]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:12 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 Apr 24 19:59:12 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:13 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 2G" returned: 0 in 0.708s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e40ec4c-f864-4f56-9ab6-767436024a90 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:13 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e40ec4c-f864-4f56-9ab6-767436024a90 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 Apr 24 19:59:13 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:13 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716" returned: 0 in 0.579s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:13 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716 Apr 24 19:59:13 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:13 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3" returned: 0 in 0.596s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:13 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3 Apr 24 19:59:13 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:13 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e40ec4c-f864-4f56-9ab6-767436024a90 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4" returned: 0 in 0.464s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:13 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 is being set with open permissions: ugo+rw Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:13 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 Apr 24 19:59:13 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:13 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b693115-1d2c-4de5-8e40-337152b33716" returned: 0 in 0.472s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-5b693115-1d2c-4de5-8e40-337152b33716" released by "delete_volume" :: held 1.092s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Created reservations ['0a410350-4522-4d3c-98a9-591d7d8ef604', '8f49f24c-343b-4ac0-90c7-6f325ff87492', 'b3469038-b0da-4197-8eb1-26e6a2d90e7f', 'f039af7f-53fe-4980-9e07-77d1098f9b3d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:13 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75ca4221-44a4-4097-ada8-2cc204e66fc3" returned: 0 in 0.448s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Lock "cinder-quobyte-75ca4221-44a4-4097-ada8-2cc204e66fc3" released by "delete_volume" :: held 1.104s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:13 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:13 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:13 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Created reservations ['9f0f2f89-55ed-4fba-b916-f4e51768548a', 'c8986374-6ade-40e2-bf34-6b2b56314f94', '6c069781-ab13-4d5d-8329-4e4e630a3eae', 'a8359136-d9e3-4287-a07d-4fdc4a65fbf6'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:14 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4" returned: 0 in 0.454s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:14 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:14 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:14 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.info Apr 24 19:59:14 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:14 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.485s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:14 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Deleted volume successfully. Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8dc43604-0316-4623-933d-51f4c09fb203 tempest-VolumesGetTest-1502477854 None] Lock "cinder-5b693115-1d2c-4de5-8e40-337152b33716-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:14 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.436s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:14 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Deleted volume successfully. Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e05b49d0-8b25-4570-91de-36f352cde0a6 tempest-VolumesTransfersTest-1191905904 None] Lock "cinder-75ca4221-44a4-4097-ada8-2cc204e66fc3-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:14 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.info" returned: 0 in 0.462s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:14 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.info is being set with open permissions: ugo+rw Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:14 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.info Apr 24 19:59:14 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-ecd2456f-1304-46ae-be9f-233a41a6a365-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Lock "cinder-ecd2456f-1304-46ae-be9f-233a41a6a365-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-quobyte-ecd2456f-1304-46ae-be9f-233a41a6a365" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-ecd2456f-1304-46ae-be9f-233a41a6a365" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dfadad-8c7d-4b0e-be02-51732ca6a091]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:15 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.info" returned: 0 in 0.452s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.184s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:15 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 Apr 24 19:59:15 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:15 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7924a1f0-0b27-4141-a982-87f9375fc76a tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Create snapshot completed successfully Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Flow 'volume_create_manager' (0147d5b0-d595-40e1-867b-6445cb904091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77cd8c3-1edb-4320-99a7-992f6a09962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77cd8c3-1edb-4320-99a7-992f6a09962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1339024930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269a9bbe-7040-4927-8c1b-bc64a4cb40fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccc6bc1467543eea4dc3eaae90ad9df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:15Z,use_quota=True,user_id='2886393f65334cf18a281fb53142da9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1846bb-85f2-4293-908e-6a99f6ed0d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1846bb-85f2-4293-908e-6a99f6ed0d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac40a704-8b4b-41a6-97a1-c9007491c1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac40a704-8b4b-41a6-97a1-c9007491c1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269a9bbe-7040-4927-8c1b-bc64a4cb40fc', 'volume_name': 'volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71dc2751-6c0c-431a-b5e9-78b1c5feb49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71dc2751-6c0c-431a-b5e9-78b1c5feb49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4497b8db-9f4f-4957-b8e9-5ee44bca0928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:15 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Volume 269a9bbe-7040-4927-8c1b-bc64a4cb40fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc', 'volume_size': 1} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1339024930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269a9bbe-7040-4927-8c1b-bc64a4cb40fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ccc6bc1467543eea4dc3eaae90ad9df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:15Z,use_quota=True,user_id='2886393f65334cf18a281fb53142da9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Creating volume 269a9bbe-7040-4927-8c1b-bc64a4cb40fc {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:15 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:15 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc 1073741824 Apr 24 19:59:15 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Acquiring lock "cinder-08c9cd0b-3e9b-495b-bd18-42a1d3f56af4-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-08c9cd0b-3e9b-495b-bd18-42a1d3f56af4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Acquiring lock "cinder-quobyte-8e40ec4c-f864-4f56-9ab6-767436024a90" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-quobyte-8e40ec4c-f864-4f56-9ab6-767436024a90" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Acquiring lock "cinder-quobyte-08c9cd0b-3e9b-495b-bd18-42a1d3f56af4" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-quobyte-08c9cd0b-3e9b-495b-bd18-42a1d3f56af4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:15 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Deleting offline snapshot 08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 of volume 8e40ec4c-f864-4f56-9ab6-767436024a90 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] snapshot_file for this snap is: volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365" returned: 0 in 0.628s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[53351c60-1e3f-4520-9786-2a7f4553e3b2]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:15 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365 Apr 24 19:59:15 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:15 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 Apr 24 19:59:15 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:16 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc 1073741824" returned: 0 in 0.618s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:16 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ecd2456f-1304-46ae-be9f-233a41a6a365" returned: 0 in 0.513s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-ecd2456f-1304-46ae-be9f-233a41a6a365" released by "delete_volume" :: held 1.197s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:16 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc Apr 24 19:59:16 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Created reservations ['cdbbdd30-5807-4146-8cf4-0064dba2b3ce', '5ea51e9b-b1dd-4e0b-8b5d-c0b3f483f5dc', 'dbe88794-cc3c-44a2-b800-3aec974a71f5', '5c384cd8-27e3-43af-82f0-070cccff97a0'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:16 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4" returned: 0 in 0.597s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e40ec4c-f864-4f56-9ab6-767436024a90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[815efd9c-4b0d-4b02-b04f-98a8a77cfbd4]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:16 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:16 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:16 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 Apr 24 19:59:16 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:16 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc" returned: 0 in 0.435s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4497b8db-9f4f-4957-b8e9-5ee44bca0928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0ef4af-0efd-4ca6-8ab1-1fdf9235f1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:16 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Volume volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc (269a9bbe-7040-4927-8c1b-bc64a4cb40fc): created successfully Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0ef4af-0efd-4ca6-8ab1-1fdf9235f1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Flow 'volume_create_manager' (0147d5b0-d595-40e1-867b-6445cb904091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:16 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-64c46a9b-9312-44bf-aa00-b30863aeba54 tempest-VolumesTransfersTest-1968484789 None] Created volume successfully. Apr 24 19:59:16 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.464s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:16 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Deleted volume successfully. Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e2279c6-6330-4e72-8a50-e4b433f19016 tempest-VolumesGetTest-1502477854 None] Lock "cinder-ecd2456f-1304-46ae-be9f-233a41a6a365-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:16 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90" returned: 0 in 0.549s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:16 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 Apr 24 19:59:16 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-456329d0-3f99-469b-96fd-c80153aa3178-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Lock "cinder-456329d0-3f99-469b-96fd-c80153aa3178-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-quobyte-456329d0-3f99-469b-96fd-c80153aa3178" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-456329d0-3f99-469b-96fd-c80153aa3178" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf867481-b2d6-498c-b119-81f924559f0a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:17 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 Apr 24 19:59:17 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:17 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4" returned: 0 in 0.574s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:17 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4 Apr 24 19:59:17 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Acquiring lock "cinder-269a9bbe-7040-4927-8c1b-bc64a4cb40fc-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Lock "cinder-269a9bbe-7040-4927-8c1b-bc64a4cb40fc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Acquiring lock "cinder-quobyte-269a9bbe-7040-4927-8c1b-bc64a4cb40fc" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Lock "cinder-quobyte-269a9bbe-7040-4927-8c1b-bc64a4cb40fc" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d94a69-7935-4dff-aed9-ee45eb926a89]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:17 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178" returned: 0 in 0.612s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:17 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90.08c9cd0b-3e9b-495b-bd18-42a1d3f56af4" returned: 0 in 0.497s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:17 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178 Apr 24 19:59:17 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:17 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc Apr 24 19:59:17 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-quobyte-08c9cd0b-3e9b-495b-bd18-42a1d3f56af4" released by "_delete_snapshot" :: held 2.350s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-quobyte-8e40ec4c-f864-4f56-9ab6-767436024a90" released by "delete_snapshot" :: held 2.375s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:17 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Created reservations ['b121e0dc-8d25-4bb2-a169-3800896dc1d7', '50cf5804-fcfa-4128-900b-b1ab94a89fcd', '4d952c9b-0260-4f93-8a08-1e3efd48379e', '3d9e2903-af6d-4e39-8e26-0ef7125743f7'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:18 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Delete snapshot completed successfully. Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c00b6e6f-82e9-4d7d-bbfb-443c3b8a3d5b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-08c9cd0b-3e9b-495b-bd18-42a1d3f56af4-delete_snapshot" released by "delete_snapshot" :: held 2.506s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:18 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-456329d0-3f99-469b-96fd-c80153aa3178" returned: 0 in 0.460s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-456329d0-3f99-469b-96fd-c80153aa3178" released by "delete_volume" :: held 1.123s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Created reservations ['f4a6cf67-b9b4-4e5d-b447-2d493ac6dd28', '9c91dbc6-bdd9-4b62-a84d-5f58dcd4d6f6', 'e8f1c9c3-27e7-48a3-a09a-f79de52cd7f2', '85550023-a8b8-49e1-bbf5-18eadbcfcd5a'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:18 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc" returned: 0 in 0.586s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:18 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc Apr 24 19:59:18 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:18 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:18 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Acquiring lock "cinder-8e40ec4c-f864-4f56-9ab6-767436024a90-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-8e40ec4c-f864-4f56-9ab6-767436024a90-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Acquiring lock "cinder-quobyte-8e40ec4c-f864-4f56-9ab6-767436024a90" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-quobyte-8e40ec4c-f864-4f56-9ab6-767436024a90" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[12435634-0244-436c-b6e6-6d8ec4ab4c48]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:18 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-269a9bbe-7040-4927-8c1b-bc64a4cb40fc" returned: 0 in 0.496s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Lock "cinder-quobyte-269a9bbe-7040-4927-8c1b-bc64a4cb40fc" released by "delete_volume" :: held 1.119s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:18 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Created reservations ['abcf92a9-990b-479f-b9da-bf2d9efd6089', '3186775f-c5e2-47a0-b4df-f3788c4ad6cc', '49a02ad5-8047-441e-ae8b-3e1acfc360c4', '3051e146-ed35-479a-a367-94f4c6a716bb'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:18 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 Apr 24 19:59:18 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:19 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:19 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:19 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.598s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:19 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Deleted volume successfully. Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d85ea244-e854-472a-a11a-d3a872b52c93 tempest-VolumesGetTest-1502477854 None] Lock "cinder-456329d0-3f99-469b-96fd-c80153aa3178-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:19 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.475s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:19 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Deleted volume successfully. Apr 24 19:59:19 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90" returned: 0 in 0.640s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d570a8a4-1567-46fc-8ace-5ea683425e46 tempest-VolumesTransfersTest-1191905904 None] Lock "cinder-269a9bbe-7040-4927-8c1b-bc64a4cb40fc-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:19 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90 Apr 24 19:59:19 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:20 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8e40ec4c-f864-4f56-9ab6-767436024a90" returned: 0 in 0.530s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-quobyte-8e40ec4c-f864-4f56-9ab6-767436024a90" released by "delete_volume" :: held 1.228s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Created reservations ['9514b94a-69bf-482e-a0af-15819cf4663d', 'ee27e157-cd41-47e9-9e5b-167bd9f5a2c2', 'a4da5f9d-1c0b-4e71-b1a2-efb995870e2f', '418294c5-acfc-44dd-9b6b-6213adf70365'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:20 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:20 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (0f712b20-d923-4e4c-a983-41f856e957a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a123b443-7950-4718-8ee0-89adad5a295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a123b443-7950-4718-8ee0-89adad5a295f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-307559802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ce8a74-a570-42e9-bc09-f5db103f84fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:20Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a73ebcb-bcf5-4ac9-bb54-f4e408c8cf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a73ebcb-bcf5-4ac9-bb54-f4e408c8cf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae0e7f0-b9b2-4fe9-ac02-b4bd1f5b316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.image.glance [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Creating Keystone auth plugin from conf {{(pid=81641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:59:20 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.508s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Deleted volume successfully. Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a3ce712f-c169-4af9-85ab-7e4138a2ce1b tempest-VolumesSnapshotNegativeTestJSON-373075620 None] Lock "cinder-8e40ec4c-f864-4f56-9ab6-767436024a90-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae0e7f0-b9b2-4fe9-ac02-b4bd1f5b316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8ce8a74-a570-42e9-bc09-f5db103f84fd', 'volume_name': 'volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c64ef96-d797-4a57-9fa8-30e754635269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c64ef96-d797-4a57-9fa8-30e754635269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a6b147-33ea-4b46-b593-251b200c2cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:20 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Volume a8ce8a74-a570-42e9-bc09-f5db103f84fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:59:20 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Trying to clone a8ce8a74-a570-42e9-bc09-f5db103f84fd from image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]). {{(pid=81641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:59:21 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:59:21 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:59:21 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[762623f4-ef1c-4c73-afd8-6911509fc096]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:21 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD Apr 24 19:59:21 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:21 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:21 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Temporary image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 is fetched for user 29c4bdad107b48caaf9d1466113c167b. {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:59:21 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da02a53-8e57-4d7f-b588-8a7c614b31b5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:22 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD Apr 24 19:59:22 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:22 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-307559802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ce8a74-a570-42e9-bc09-f5db103f84fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:20Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Creating volume a8ce8a74-a570-42e9-bc09-f5db103f84fd {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:22 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:59:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:22 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd 1073741824 Apr 24 19:59:22 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:23 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd 1073741824" returned: 0 in 0.802s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:23 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd Apr 24 19:59:23 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:23 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd" returned: 0 in 0.532s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:59:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:23 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Attempting download of 2f4436ec-2be7-46ed-af6e-ed3ceb305141 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}])) to volume a8ce8a74-a570-42e9-bc09-f5db103f84fd. {{(pid=81641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[938cea49-2121-4a0d-b7c5-6790b7d1c568]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_plo8ncv5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:24 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_plo8ncv5 Apr 24 19:59:24 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Flow 'volume_create_manager' (4251ad4b-8325-4b7c-91de-b4ac1338cb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1f7ed7-5665-4f65-834e-6d49d90eaf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1f7ed7-5665-4f65-834e-6d49d90eaf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2095878211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e997996-0668-4169-b748-d3ad4f51e476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b5c94edd2f4aa8bc5613f593f97ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:24Z,use_quota=True,user_id='d566c002064049a0879994aa634f046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f022122f-41cb-47ec-bacc-d919ac851c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f022122f-41cb-47ec-bacc-d919ac851c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f243dff-e380-4f7a-bf01-9badc5e19366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f243dff-e380-4f7a-bf01-9badc5e19366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e997996-0668-4169-b748-d3ad4f51e476', 'volume_name': 'volume-1e997996-0668-4169-b748-d3ad4f51e476', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4de6453-8721-4f72-aaa5-06cf8e526a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4de6453-8721-4f72-aaa5-06cf8e526a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924cfa03-94c1-4f54-ba54-4fdd0094d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:24 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Volume 1e997996-0668-4169-b748-d3ad4f51e476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e997996-0668-4169-b748-d3ad4f51e476', 'volume_size': 1} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2095878211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e997996-0668-4169-b748-d3ad4f51e476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b5c94edd2f4aa8bc5613f593f97ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:24Z,use_quota=True,user_id='d566c002064049a0879994aa634f046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Creating volume 1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:24 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:24 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 1073741824 Apr 24 19:59:24 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:24 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_plo8ncv5" returned: 0 in 0.667s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_plo8ncv5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:24 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_plo8ncv5 Apr 24 19:59:24 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:25 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 1073741824" returned: 0 in 0.752s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:25 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 Apr 24 19:59:25 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:25 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_plo8ncv5" returned: 1 in 0.639s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_plo8ncv5' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1446ad11-29f2-4ee7-bd5d-08805314178a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:25 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD Apr 24 19:59:25 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:25 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476" returned: 0 in 0.595s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924cfa03-94c1-4f54-ba54-4fdd0094d27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e997996-0668-4169-b748-d3ad4f51e476', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a68ddeb-c361-412c-8cd0-a3480a2c97e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:25 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Volume volume-1e997996-0668-4169-b748-d3ad4f51e476 (1e997996-0668-4169-b748-d3ad4f51e476): created successfully Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a68ddeb-c361-412c-8cd0-a3480a2c97e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Flow 'volume_create_manager' (4251ad4b-8325-4b7c-91de-b4ac1338cb44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:25 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5850575b-4c18-45a1-8bd7-df2f5e4727a7 tempest-VolumeDependencyTests-191085666 None] Created volume successfully. Apr 24 19:59:26 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:26 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] 2f4436ec-2be7-46ed-af6e-ed3ceb305141 was qcow2, converting to raw {{(pid=81641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:59:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:26 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd Apr 24 19:59:26 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Creating offline snapshot 3ecfefad-d757-4a38-ab12-08678946cb58 of volume 1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:59:26 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0acd998-b8eb-4670-aa6b-572cde1fe054]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:26 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 Apr 24 19:59:26 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:27 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476" returned: 0 in 0.767s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:27 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 1G Apr 24 19:59:27 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:27 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd" returned: 0 in 1.583s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:27 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141__cgzy6eodevstack@QuobyteHD, size 112.00 MB, duration 1.58 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:59:27 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Converted 112.00 MB image at 70.68 MB/s Apr 24 19:59:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:27 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd 1G Apr 24 19:59:27 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:28 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 1G" returned: 0 in 0.644s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e997996-0668-4169-b748-d3ad4f51e476 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:28 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e997996-0668-4169-b748-d3ad4f51e476 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 Apr 24 19:59:28 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:28 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd 1G" returned: 0 in 0.511s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:28 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93859e5-a8ce-4ca9-b3ba-583dddc72dcc]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:28 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd Apr 24 19:59:28 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:28 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e997996-0668-4169-b748-d3ad4f51e476 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58" returned: 0 in 0.600s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:28 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 is being set with open permissions: ugo+rw Apr 24 19:59:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:28 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 Apr 24 19:59:28 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:28 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd" returned: 0 in 0.614s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:28 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd Apr 24 19:59:28 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:29 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58" returned: 0 in 0.496s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:29 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.info Apr 24 19:59:29 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:29 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd" returned: 1 in 0.564s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Downloaded image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}])) to volume a8ce8a74-a570-42e9-bc09-f5db103f84fd successfully. {{(pid=81641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Temporary image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 for user 29c4bdad107b48caaf9d1466113c167b is deleted. {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Marking volume a8ce8a74-a570-42e9-bc09-f5db103f84fd as bootable. {{(pid=81641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Copying metadata from image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 to a8ce8a74-a570-42e9-bc09-f5db103f84fd. {{(pid=81641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Creating volume glance metadata for volume a8ce8a74-a570-42e9-bc09-f5db103f84fd backed by image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a6b147-33ea-4b46-b593-251b200c2cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01be57d4-eb3d-4a01-8a15-fb639dce7b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:29 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Volume volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd (a8ce8a74-a570-42e9-bc09-f5db103f84fd): created successfully Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01be57d4-eb3d-4a01-8a15-fb639dce7b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (0f712b20-d923-4e4c-a983-41f856e957a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:29 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e2235242-7e16-4c7e-9cf6-08828626152b tempest-VolumesGetTest-1502477854 None] Created volume successfully. Apr 24 19:59:29 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.info" returned: 0 in 0.507s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:29 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.info is being set with open permissions: ugo+rw Apr 24 19:59:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:29 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.info Apr 24 19:59:29 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:30 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.info" returned: 0 in 0.528s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.645s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7a7b7cc5-6a23-49f1-9b61-9092285653c0 tempest-VolumeDependencyTests-191085666 None] Create snapshot completed successfully Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (e392d2b0-c174-4e27-a8c8-edffdd177ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9a04b8-f695-4b08-a040-a6dfa85d8cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9a04b8-f695-4b08-a040-a6dfa85d8cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-311598830',display_name='tempest-VolumesGetTest-Volume-1807663008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c467b0-0e49-4e3e-814c-2ade44c40893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:31Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ee3f6-3630-4b9c-8af7-7062a2c48f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ee3f6-3630-4b9c-8af7-7062a2c48f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a586022-2d3a-447c-a560-3139811a9541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a586022-2d3a-447c-a560-3139811a9541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c467b0-0e49-4e3e-814c-2ade44c40893', 'volume_name': 'volume-a9c467b0-0e49-4e3e-814c-2ade44c40893', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b9f96c-3b30-4cbe-951b-0c312df0f4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b9f96c-3b30-4cbe-951b-0c312df0f4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0076f1-54a3-4ec7-b803-1010ed60317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:30 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Volume a9c467b0-0e49-4e3e-814c-2ade44c40893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c467b0-0e49-4e3e-814c-2ade44c40893', 'volume_size': 1} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-311598830',display_name='tempest-VolumesGetTest-Volume-1807663008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c467b0-0e49-4e3e-814c-2ade44c40893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b5888044d14210a5b651435cf12a23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:31Z,use_quota=True,user_id='29c4bdad107b48caaf9d1466113c167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Creating volume a9c467b0-0e49-4e3e-814c-2ade44c40893 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:30 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:59:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:30 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 1073741824 Apr 24 19:59:30 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Flow 'volume_create_manager' (7cd41ece-c596-447c-beba-a554714913b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e2f817-7435-4058-b80b-1487f2e6fc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e2f817-7435-4058-b80b-1487f2e6fc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-784164049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b5c94edd2f4aa8bc5613f593f97ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ecfefad-d757-4a38-ab12-08678946cb58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:31Z,use_quota=True,user_id='d566c002064049a0879994aa634f046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9111b0-c29f-4562-acad-7b60f4b9d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9111b0-c29f-4562-acad-7b60f4b9d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e10c40-332a-4cca-8fe5-0923883ec52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e10c40-332a-4cca-8fe5-0923883ec52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3', 'volume_name': 'volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3', 'volume_size': 1, 'snapshot_id': '3ecfefad-d757-4a38-ab12-08678946cb58'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85035bfa-87c9-4eb3-bdc4-061dedadfffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85035bfa-87c9-4eb3-bdc4-061dedadfffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f928faf-df61-460e-ac1b-fb32b7b8ae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:31 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Volume 6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3', 'volume_size': 1, 'snapshot_id': '3ecfefad-d757-4a38-ab12-08678946cb58'} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:31 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 1073741824" returned: 0 in 0.778s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:31 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 Apr 24 19:59:31 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:32 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893" returned: 0 in 0.576s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.767s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-3ecfefad-d757-4a38-ab12-08678946cb58-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" by "_create_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0076f1-54a3-4ec7-b803-1010ed60317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c467b0-0e49-4e3e-814c-2ade44c40893', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7240b7-727d-4162-a119-c2d76934b7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:32 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Volume volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 (a9c467b0-0e49-4e3e-814c-2ade44c40893): created successfully Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7240b7-727d-4162-a119-c2d76934b7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Flow 'volume_create_manager' (e392d2b0-c174-4e27-a8c8-edffdd177ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-3ecfefad-d757-4a38-ab12-08678946cb58-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Creating volume 6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 from snapshot 3ecfefad-d757-4a38-ab12-08678946cb58 {{(pid=81641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] snapshot: 3ecfefad-d757-4a38-ab12-08678946cb58, volume: 6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:59:32 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2d485b29-0caa-4b15-af36-92d3d1f395fd tempest-VolumesGetTest-1502477854 None] Created volume successfully. Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24f8e17-09bd-4753-a063-eaafac297363]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:32 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 Apr 24 19:59:32 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-a9c467b0-0e49-4e3e-814c-2ade44c40893-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:32 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Lock "cinder-a9c467b0-0e49-4e3e-814c-2ade44c40893-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58" returned: 0 in 0.673s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e997996-0668-4169-b748-d3ad4f51e476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-quobyte-a9c467b0-0e49-4e3e-814c-2ade44c40893" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e6fad1-aea0-4320-ac67-e22f7ff008fc]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-a9c467b0-0e49-4e3e-814c-2ade44c40893" acquired by "delete_volume" :: waited 0.036s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae6f3b4-a0ef-480d-b3d1-471f246df10f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:33 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 Apr 24 19:59:33 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:33 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 Apr 24 19:59:33 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:33 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476" returned: 0 in 0.681s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:33 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:59:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:33 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 Apr 24 19:59:33 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:33 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893" returned: 0 in 0.753s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:33 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893 Apr 24 19:59:33 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Flow 'volume_create_manager' (c4fbe27e-eadd-4133-8551-e77adc3a5e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62cbe2c8-64d9-4651-91b1-03c0e8d49b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62cbe2c8-64d9-4651-91b1-03c0e8d49b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-280379006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aefd9cf-ec70-42d7-9285-bf87058d107a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da03230dd3b4cb0b310f853e16b3845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:34Z,use_quota=True,user_id='c8193ce82b554407a0508ed97e48253c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840c29e8-bbaf-4c8e-b26b-994c97f49a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840c29e8-bbaf-4c8e-b26b-994c97f49a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c637ac-73b9-46eb-adfd-51cbbd7d25ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c637ac-73b9-46eb-adfd-51cbbd7d25ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aefd9cf-ec70-42d7-9285-bf87058d107a', 'volume_name': 'volume-2aefd9cf-ec70-42d7-9285-bf87058d107a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6c1d4b-0a20-475e-9270-dea94511b142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6c1d4b-0a20-475e-9270-dea94511b142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e911891-636c-4b8d-8783-fcdacb9c98e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:34 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Volume 2aefd9cf-ec70-42d7-9285-bf87058d107a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aefd9cf-ec70-42d7-9285-bf87058d107a', 'volume_size': 1} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:34 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a9c467b0-0e49-4e3e-814c-2ade44c40893" returned: 0 in 0.581s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-a9c467b0-0e49-4e3e-814c-2ade44c40893" released by "delete_volume" :: held 1.375s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Created reservations ['1cc5a95f-04a8-41c6-a567-1911b7fda804', '4e34a849-d5f0-4be8-a7a3-871062d95266', '8916a08d-da62-4b82-b00b-7d6f451c483e', '5c8bb344-0ba9-413f-8c41-647f4f6cedef'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:34 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:34 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-a8ce8a74-a570-42e9-bc09-f5db103f84fd-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Lock "cinder-a8ce8a74-a570-42e9-bc09-f5db103f84fd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Acquiring lock "cinder-quobyte-a8ce8a74-a570-42e9-bc09-f5db103f84fd" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-a8ce8a74-a570-42e9-bc09-f5db103f84fd" acquired by "delete_volume" :: waited 0.050s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:35 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e5123-3c7b-4b4f-8d9d-34b4a0df0166]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:35 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.106s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:35 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:35 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Deleted volume successfully. Apr 24 19:59:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-02004d75-85b6-4f00-ab86-52212b7a1c6c tempest-VolumesGetTest-1502477854 None] Lock "cinder-a9c467b0-0e49-4e3e-814c-2ade44c40893-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:35 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd Apr 24 19:59:35 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:36 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd" returned: 0 in 1.215s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:36 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd Apr 24 19:59:36 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:37 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd" returned: 1 in 1.162s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:59:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:37 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd Apr 24 19:59:37 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:38 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a8ce8a74-a570-42e9-bc09-f5db103f84fd" returned: 0 in 0.758s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Lock "cinder-quobyte-a8ce8a74-a570-42e9-bc09-f5db103f84fd" released by "delete_volume" :: held 3.226s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:38 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" returned: 0 in 5.009s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[754941e5-7851-48f9-b748-6470666d2497]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Created reservations ['fb1e648a-bb4e-483c-8934-e00b2713d4eb', 'e9c2a30e-1f68-484e-aa5b-a5f7cc281a90', 'be5257c4-908a-4473-b447-9bd07fa66a4b', '85899859-3f7b-4cae-abb7-78ea519f9ae0'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:38 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 Apr 24 19:59:38 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:38 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:38 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:39 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.436s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Deleted volume successfully. Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b70764e2-616c-4ad9-a4df-50b7fc18495c tempest-VolumesGetTest-1502477854 None] Lock "cinder-a8ce8a74-a570-42e9-bc09-f5db103f84fd-delete_volume" released by "delete_volume" :: held 3.942s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:39 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476" returned: 0 in 0.681s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:59:39 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Converted 1024.00 MB image at 204.40 MB/s Apr 24 19:59:39 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 is being set with open permissions: ugo+rw Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:39 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 Apr 24 19:59:39 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:39 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" returned: 0 in 0.492s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" released by "_copy_volume_from_snapshot" :: held 7.671s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-3ecfefad-d757-4a38-ab12-08678946cb58-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" released by "_create_volume_from_snapshot" :: held 7.715s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.761s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.683s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-280379006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aefd9cf-ec70-42d7-9285-bf87058d107a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da03230dd3b4cb0b310f853e16b3845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:34Z,use_quota=True,user_id='c8193ce82b554407a0508ed97e48253c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Creating volume 2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:39 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:39 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a 1073741824 Apr 24 19:59:39 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f928faf-df61-460e-ac1b-fb32b7b8ae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3', 'volume_size': 1, 'snapshot_id': '3ecfefad-d757-4a38-ab12-08678946cb58'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56117eec-4a18-4775-b2a8-be0039e7b1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:39 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Volume volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 (6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3): created successfully Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56117eec-4a18-4775-b2a8-be0039e7b1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:39 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Flow 'volume_create_manager' (7cd41ece-c596-447c-beba-a554714913b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-839d8f35-1a31-446f-896e-1f8da414fdc4 tempest-VolumeDependencyTests-191085666 None] Created volume successfully. Apr 24 19:59:40 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a 1073741824" returned: 0 in 0.701s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:40 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a Apr 24 19:59:40 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-3ecfefad-d757-4a38-ab12-08678946cb58-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-3ecfefad-d757-4a38-ab12-08678946cb58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-1e997996-0668-4169-b748-d3ad4f51e476" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-1e997996-0668-4169-b748-d3ad4f51e476" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-3ecfefad-d757-4a38-ab12-08678946cb58" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-3ecfefad-d757-4a38-ab12-08678946cb58" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Deleting offline snapshot 3ecfefad-d757-4a38-ab12-08678946cb58 of volume 1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] snapshot_file for this snap is: volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0d005d-fc0f-4a41-9a77-74f8297c0aca]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:41 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a" returned: 0 in 0.600s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e911891-636c-4b8d-8783-fcdacb9c98e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aefd9cf-ec70-42d7-9285-bf87058d107a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca589757-da7a-4fda-a9a7-fbb5b2c36879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:41 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Volume volume-2aefd9cf-ec70-42d7-9285-bf87058d107a (2aefd9cf-ec70-42d7-9285-bf87058d107a): created successfully Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca589757-da7a-4fda-a9a7-fbb5b2c36879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Flow 'volume_create_manager' (c4fbe27e-eadd-4133-8551-e77adc3a5e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:41 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 Apr 24 19:59:41 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:41 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-c7d9a81f-2ee5-435f-a024-2287123a7617 tempest-VolumesActionsTest-1573217736 None] Created volume successfully. Apr 24 19:59:41 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58" returned: 0 in 0.593s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e997996-0668-4169-b748-d3ad4f51e476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[602b205b-14b9-41e0-a33f-300d32e8124a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:41 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 Apr 24 19:59:41 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:42 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476" returned: 0 in 0.658s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:42 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 Apr 24 19:59:42 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:43 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58" returned: 0 in 0.631s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:43 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58 Apr 24 19:59:43 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:43 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476.3ecfefad-d757-4a38-ab12-08678946cb58" returned: 0 in 0.514s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-3ecfefad-d757-4a38-ab12-08678946cb58" released by "_delete_snapshot" :: held 2.522s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-1e997996-0668-4169-b748-d3ad4f51e476" released by "delete_snapshot" :: held 2.548s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:43 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Created reservations ['506d6a22-ca5a-4990-9334-3abe8109df07', '8b1ceb10-532e-4f95-924f-a89376b280aa', '5bf0281c-f163-4dd8-852b-3661b6458ea5', 'fe8ec332-c2eb-4fd1-9817-1499e3bc1d06'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:43 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Delete snapshot completed successfully. Apr 24 19:59:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-349d84fe-0ae0-4b0a-8ef6-7d3a9c8c44d3 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-3ecfefad-d757-4a38-ab12-08678946cb58-delete_snapshot" released by "delete_snapshot" :: held 2.694s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-1e997996-0668-4169-b748-d3ad4f51e476-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-1e997996-0668-4169-b748-d3ad4f51e476-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-1e997996-0668-4169-b748-d3ad4f51e476" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-1e997996-0668-4169-b748-d3ad4f51e476" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:44 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a70d5c-23c2-4e2f-ab58-3c01d9c16645]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:44 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 Apr 24 19:59:44 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:44 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476" returned: 0 in 0.637s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:45 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476 Apr 24 19:59:45 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:45 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1e997996-0668-4169-b748-d3ad4f51e476" returned: 0 in 0.525s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-1e997996-0668-4169-b748-d3ad4f51e476" released by "delete_volume" :: held 1.239s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:45 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Created reservations ['635c2b7a-29cb-4930-80a4-a387978d6819', '58f5528c-7dad-494d-8b4a-dd762ce308cf', '995514cb-801a-4a85-b45d-d367808186c6', '071b42f9-c27e-42fb-ac79-c9aef4fc161d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:59:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:45 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:45 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:46 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.544s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:46 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Deleted volume successfully. Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f24ad96-b0e9-4c77-8975-33fce3f6fe40 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-1e997996-0668-4169-b748-d3ad4f51e476-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Flow 'volume_create_manager' (01fdad84-a3d4-4418-935d-3fb8595e66a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83342f8-40d1-4f04-aed8-03af360203ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83342f8-40d1-4f04-aed8-03af360203ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1876457565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8727f15-47e9-4936-9579-13e6c430df9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b5c94edd2f4aa8bc5613f593f97ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:47Z,use_quota=True,user_id='d566c002064049a0879994aa634f046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939281ad-759e-4d57-8538-afb0d0f52a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939281ad-759e-4d57-8538-afb0d0f52a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc8a78a-fa0d-4a52-99be-54811fb36cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc8a78a-fa0d-4a52-99be-54811fb36cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8727f15-47e9-4936-9579-13e6c430df9e', 'volume_name': 'volume-f8727f15-47e9-4936-9579-13e6c430df9e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb703c7-4688-4905-b154-aa66e83e254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb703c7-4688-4905-b154-aa66e83e254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5639616-a632-43e1-bd6b-1f3fe5895540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:46 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Volume f8727f15-47e9-4936-9579-13e6c430df9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8727f15-47e9-4936-9579-13e6c430df9e', 'volume_size': 1} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1876457565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8727f15-47e9-4936-9579-13e6c430df9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b5c94edd2f4aa8bc5613f593f97ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:47Z,use_quota=True,user_id='d566c002064049a0879994aa634f046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Creating volume f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:59:46 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 19:59:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:46 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e 1073741824 Apr 24 19:59:46 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:47 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e 1073741824" returned: 0 in 0.721s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:47 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e Apr 24 19:59:47 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:48 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e" returned: 0 in 0.560s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:59:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5639616-a632-43e1-bd6b-1f3fe5895540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8727f15-47e9-4936-9579-13e6c430df9e', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6271b51b-588c-4c06-b57c-f62bd98d03bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:48 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Volume volume-f8727f15-47e9-4936-9579-13e6c430df9e (f8727f15-47e9-4936-9579-13e6c430df9e): created successfully Apr 24 19:59:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6271b51b-588c-4c06-b57c-f62bd98d03bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Flow 'volume_create_manager' (01fdad84-a3d4-4418-935d-3fb8595e66a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:48 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e898068e-54f2-4290-9e6c-d39f0d235816 tempest-VolumeDependencyTests-191085666 None] Created volume successfully. Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Flow 'volume_create_manager' (b01392aa-8368-4242-b469-9b4c41460b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee82693-0a5e-497e-baa2-bde658a27022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee82693-0a5e-497e-baa2-bde658a27022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1605189124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b431bec1-2970-4905-9d8e-05284f541bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b5c94edd2f4aa8bc5613f593f97ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f8727f15-47e9-4936-9579-13e6c430df9e,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:50Z,use_quota=True,user_id='d566c002064049a0879994aa634f046b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2318c279-0372-45b2-966f-6a9c6df2d506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2318c279-0372-45b2-966f-6a9c6df2d506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c65956-a484-4a4a-8d1a-c43f87aa453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c65956-a484-4a4a-8d1a-c43f87aa453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b431bec1-2970-4905-9d8e-05284f541bd2', 'volume_name': 'volume-b431bec1-2970-4905-9d8e-05284f541bd2', 'volume_size': 1, 'source_volid': 'f8727f15-47e9-4936-9579-13e6c430df9e', 'source_volstatus': 'available'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14968b9f-3c34-4fd4-802d-8b90f64665ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14968b9f-3c34-4fd4-802d-8b90f64665ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d49c54f-5a6b-46c8-ba2b-95349c5587f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:49 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Volume b431bec1-2970-4905-9d8e-05284f541bd2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b431bec1-2970-4905-9d8e-05284f541bd2', 'volume_size': 1, 'source_volid': 'f8727f15-47e9-4936-9579-13e6c430df9e', 'source_volstatus': 'available'} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:49 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Cloning volume f8727f15-47e9-4936-9579-13e6c430df9e to volume b431bec1-2970-4905-9d8e-05284f541bd2 Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Creating offline snapshot a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c of volume f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bc6bbc-8982-4004-a76b-28c3a4d77e6c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:49 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e Apr 24 19:59:49 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:50 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e" returned: 0 in 0.685s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:50 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c 1G Apr 24 19:59:50 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:51 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c 1G" returned: 0 in 0.822s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8727f15-47e9-4936-9579-13e6c430df9e -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:51 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8727f15-47e9-4936-9579-13e6c430df9e -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c Apr 24 19:59:51 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:52 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8727f15-47e9-4936-9579-13e6c430df9e -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c" returned: 0 in 0.663s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:52 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c is being set with open permissions: ugo+rw Apr 24 19:59:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:52 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c Apr 24 19:59:52 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:52 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c" returned: 0 in 0.548s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:52 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.info Apr 24 19:59:52 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:53 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 19:59:53 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:53 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.info" returned: 0 in 0.550s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:53 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.info is being set with open permissions: ugo+rw Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:53 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.info Apr 24 19:59:53 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:53 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.661s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:59:53 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.info" returned: 0 in 0.761s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-b431bec1-2970-4905-9d8e-05284f541bd2" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-b431bec1-2970-4905-9d8e-05284f541bd2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] snapshot: a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c, volume: b431bec1-2970-4905-9d8e-05284f541bd2, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[74121155-a93d-44b5-991a-41dd9f1a5291]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:54 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c Apr 24 19:59:54 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=116,cinder:UPDATE=161,cinder:INSERT=37,cinder:DELETE=10 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=115,cinder:UPDATE=134,cinder:DELETE=16,cinder:INSERT=48 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (12407da3-2f83-44af-9dde-5554762d66a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ec198d-b83c-4d7a-a063-fe46d371447a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:54 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c" returned: 0 in 0.588s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8727f15-47e9-4936-9579-13e6c430df9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ec198d-b83c-4d7a-a063-fe46d371447a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-147401836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a74a90-bc48-4a6e-8228-dd40a3ddb152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd38c125242aeb38b2e0045c259fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:55Z,use_quota=True,user_id='3a439558a96f4f1cb4724c6b29238d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3408b6-7249-44b0-b4b2-8b9ab74076e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3408b6-7249-44b0-b4b2-8b9ab74076e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec41e7b6-0ed4-438e-b64c-4e20c9f9fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec41e7b6-0ed4-438e-b64c-4e20c9f9fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a74a90-bc48-4a6e-8228-dd40a3ddb152', 'volume_name': 'volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e298df-98fd-484e-a233-c21103bf42da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e298df-98fd-484e-a233-c21103bf42da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a929fcc-0639-4119-88d3-7e7602a1c46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:59:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Volume 05a74a90-bc48-4a6e-8228-dd40a3ddb152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152', 'volume_size': 1} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f4c879-be00-43c4-91ce-a50d5f51be65]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:59:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:54 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e Apr 24 19:59:54 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:59:55 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 24 19:59:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e" returned: 0 in 0.521s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:59:55 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:59:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:59:55 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 Apr 24 19:59:55 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:00 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2" returned: 0 in 5.776s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:00 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[564ff917-7b7b-4444-95a2-b4d89f119ef8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:01 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e Apr 24 20:00:01 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:01 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e" returned: 0 in 0.744s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:01 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:00:01 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Converted 1024.00 MB image at 177.18 MB/s Apr 24 20:00:01 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 is being set with open permissions: ugo+rw Apr 24 20:00:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:01 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 Apr 24 20:00:01 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:02 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2" returned: 0 in 0.601s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-b431bec1-2970-4905-9d8e-05284f541bd2" released by "_copy_volume_from_snapshot" :: held 8.357s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Deleting offline snapshot a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c of volume f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] snapshot_file for this snap is: volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[65760954-3fa2-4ab7-b1c6-55b666071acc]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:02 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c Apr 24 20:00:02 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cf6a4d6a-9bb3-45d0-84aa-f93c43d2d9ac tempest-VolumesActionsTest-1573217736 None] Acquiring lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a" by "attach_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cf6a4d6a-9bb3-45d0-84aa-f93c43d2d9ac tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a" acquired by "attach_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-cf6a4d6a-9bb3-45d0-84aa-f93c43d2d9ac tempest-VolumesActionsTest-1573217736 None] Attaching volume 2aefd9cf-ec70-42d7-9285-bf87058d107a to instance 52ba0db3-dfc3-426f-aeb9-31d38cd024da at mountpoint /dev/vdb on host None. Apr 24 20:00:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-cf6a4d6a-9bb3-45d0-84aa-f93c43d2d9ac tempest-VolumesActionsTest-1573217736 None] Attach volume completed successfully. Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-cf6a4d6a-9bb3-45d0-84aa-f93c43d2d9ac tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a" released by "attach_volume" :: held 0.094s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:02 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c" returned: 0 in 0.540s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8727f15-47e9-4936-9579-13e6c430df9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b100da7-ffeb-48ad-bb0c-5900e61a7e4b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:03 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e Apr 24 20:00:03 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-386ef102-a001-458d-9fbe-1b968cfbc48d tempest-VolumesActionsTest-1573217736 None] Acquiring lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a-detach_volume" by "detach_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-386ef102-a001-458d-9fbe-1b968cfbc48d tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:03 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-386ef102-a001-458d-9fbe-1b968cfbc48d tempest-VolumesActionsTest-1573217736 None] Detaching volume 2aefd9cf-ec70-42d7-9285-bf87058d107a from instance 52ba0db3-dfc3-426f-aeb9-31d38cd024da. Apr 24 20:00:03 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-386ef102-a001-458d-9fbe-1b968cfbc48d tempest-VolumesActionsTest-1573217736 None] Detach volume completed successfully. Apr 24 20:00:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-386ef102-a001-458d-9fbe-1b968cfbc48d tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:03 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e" returned: 0 in 0.588s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:03 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c Apr 24 20:00:03 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:04 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c" returned: 0 in 0.657s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:04 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c Apr 24 20:00:04 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:04 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e.a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c" returned: 0 in 0.485s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-a4ef4d23-0556-4a3b-abc6-6d7a5fa01a0c" released by "_delete_snapshot" :: held 2.370s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.028s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.198s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-147401836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a74a90-bc48-4a6e-8228-dd40a3ddb152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd38c125242aeb38b2e0045c259fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:59:55Z,use_quota=True,user_id='3a439558a96f4f1cb4724c6b29238d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Creating volume 05a74a90-bc48-4a6e-8228-dd40a3ddb152 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:00:04 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d49c54f-5a6b-46c8-ba2b-95349c5587f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b431bec1-2970-4905-9d8e-05284f541bd2', 'volume_size': 1, 'source_volid': 'f8727f15-47e9-4936-9579-13e6c430df9e', 'source_volstatus': 'available'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6d58f7-65d6-4882-aed5-d99da745a1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:04 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 1073741824 Apr 24 20:00:04 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:04 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Volume volume-b431bec1-2970-4905-9d8e-05284f541bd2 (b431bec1-2970-4905-9d8e-05284f541bd2): created successfully Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6d58f7-65d6-4882-aed5-d99da745a1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Flow 'volume_create_manager' (b01392aa-8368-4242-b469-9b4c41460b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:00:04 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6c204657-39aa-4630-8f34-4efb20ccdc99 tempest-VolumeDependencyTests-191085666 None] Created volume successfully. Apr 24 20:00:05 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 1073741824" returned: 0 in 0.818s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:05 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 Apr 24 20:00:05 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-f8727f15-47e9-4936-9579-13e6c430df9e-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-f8727f15-47e9-4936-9579-13e6c430df9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-f8727f15-47e9-4936-9579-13e6c430df9e" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-f8727f15-47e9-4936-9579-13e6c430df9e" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d3274-ea61-4838-afa1-92a3480c590f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:06 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152" returned: 0 in 0.495s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a929fcc-0639-4119-88d3-7e7602a1c46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122f2559-91d2-4744-970a-b618f85c0b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:06 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Volume volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 (05a74a90-bc48-4a6e-8228-dd40a3ddb152): created successfully Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122f2559-91d2-4744-970a-b618f85c0b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (12407da3-2f83-44af-9dde-5554762d66a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:00:06 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7bf4c055-c7ed-419c-b086-0d06d7930052 tempest-VolumesSnapshotTestJSON-575565307 None] Created volume successfully. Apr 24 20:00:06 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e Apr 24 20:00:06 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:06 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e" returned: 0 in 0.561s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:06 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e Apr 24 20:00:06 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Creating offline snapshot d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd of volume 05a74a90-bc48-4a6e-8228-dd40a3ddb152 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a42b96a-7358-42db-a911-ff3de46e7f0b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:07 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 Apr 24 20:00:07 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:07 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f8727f15-47e9-4936-9579-13e6c430df9e" returned: 0 in 0.602s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-f8727f15-47e9-4936-9579-13e6c430df9e" released by "delete_volume" :: held 1.241s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Created reservations ['7e82673d-f7b3-4148-9662-99f1a8b07cbb', '6150652b-d66a-4e24-8e45-2a7bea66c92a', '98572314-e112-42d2-9cd6-75bfeb8814d5', 'f3bad0fd-36c5-4f54-8285-8013dcd1701d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:07 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:00:07 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:07 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152" returned: 0 in 0.627s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:07 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd 1G Apr 24 20:00:07 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:07 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.475s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:00:07 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Deleted volume successfully. Apr 24 20:00:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b9a0707c-de44-4e24-83b9-7287a91a3770 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-f8727f15-47e9-4936-9579-13e6c430df9e-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:08 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd 1G" returned: 0 in 0.662s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:08 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd Apr 24 20:00:08 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-b431bec1-2970-4905-9d8e-05284f541bd2-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-b431bec1-2970-4905-9d8e-05284f541bd2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-b431bec1-2970-4905-9d8e-05284f541bd2" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-b431bec1-2970-4905-9d8e-05284f541bd2" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f6d517-935c-48f9-a585-a6e25886aa75]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:08 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 Apr 24 20:00:08 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:08 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd" returned: 0 in 0.537s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:08 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd is being set with open permissions: ugo+rw Apr 24 20:00:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:08 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd Apr 24 20:00:08 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:09 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2" returned: 0 in 0.598s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:09 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2 Apr 24 20:00:09 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:09 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd" returned: 0 in 0.471s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:09 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.info Apr 24 20:00:09 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:09 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-b431bec1-2970-4905-9d8e-05284f541bd2" returned: 0 in 0.470s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-b431bec1-2970-4905-9d8e-05284f541bd2" released by "delete_volume" :: held 1.109s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Created reservations ['2cff0093-791e-43ce-8da8-22fdd1185795', '6a294e72-59d6-4787-b8e4-9f98b5181e38', '11ce9d27-1587-4908-8f4b-dccce8764e12', '49dcc62a-d927-4212-b10a-3af4567bffa6'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:09 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:00:09 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:09 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.info" returned: 0 in 0.517s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:09 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.info is being set with open permissions: ugo+rw Apr 24 20:00:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:09 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.info Apr 24 20:00:09 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:10 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.440s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:00:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Deleted volume successfully. Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e42de1a5-45ca-43a3-92a9-8a7f3aa6d761 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-b431bec1-2970-4905-9d8e-05284f541bd2-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:10 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.info" returned: 0 in 0.472s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b4420390-ac54-475a-adc9-1fbae14c18fd tempest-VolumesSnapshotTestJSON-575565307 None] Create snapshot completed successfully Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "cinder-quobyte-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b79cb3-ddd1-4b66-8cda-9a339690b378]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:10 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 Apr 24 20:00:10 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:11 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" returned: 0 in 0.582s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:11 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3 Apr 24 20:00:11 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-05a74a90-bc48-4a6e-8228-dd40a3ddb152" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-05a74a90-bc48-4a6e-8228-dd40a3ddb152" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Deleting offline snapshot d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd of volume 05a74a90-bc48-4a6e-8228-dd40a3ddb152 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] snapshot_file for this snap is: volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f15c67-828f-4305-8a64-5912b4438902]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:11 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd Apr 24 20:00:11 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:11 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" returned: 0 in 0.510s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-quobyte-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3" released by "delete_volume" :: held 1.133s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Created reservations ['311a356f-7304-46ad-a1c4-5dadaab200a3', 'c91d3b0b-9a5a-4601-9a08-d06af67b1615', '6e9462f5-c5d3-4d24-a2b5-a735e282bf4b', 'fb6f7f3b-85a7-424e-8c67-d99119e871bf'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:11 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:00:11 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:12 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd" returned: 0 in 0.681s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:00:12 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad70c51-a19c-4e08-8a5e-e33f751c1dfc]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:12 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 Apr 24 20:00:12 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:12 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.478s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:12 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:00:12 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Deleted volume successfully. Apr 24 20:00:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f99e2dab-d016-42f4-8e97-e569c8665187 tempest-VolumeDependencyTests-191085666 None] Lock "cinder-6e5f0c87-eb4b-47dd-ad26-7ac704e70ba3-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:12 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152" returned: 0 in 0.545s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:12 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd Apr 24 20:00:12 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:13 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd" returned: 0 in 0.660s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:13 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd Apr 24 20:00:13 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:13 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152.d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd" returned: 0 in 0.490s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd" released by "_delete_snapshot" :: held 2.517s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-05a74a90-bc48-4a6e-8228-dd40a3ddb152" released by "delete_snapshot" :: held 2.544s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:13 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Created reservations ['d6fa482b-04a6-45d3-a7c7-4cb8f2059c95', '45e60377-8c23-439b-8c99-3609e4fa6d54', '68d2342a-30dc-496a-b825-9f23b96541c0', '07c77b1a-f671-4c1f-93d3-fa8090354493'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:00:14 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Delete snapshot completed successfully. Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8ddf7efa-07d8-4971-bab0-688304a29249 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-d5ab6174-79ab-4000-b8a2-5f9cf09f1cdd-delete_snapshot" released by "delete_snapshot" :: held 2.770s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (7a0497d4-ef44-4d6a-8d0b-519712676889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3b4aa1-e3fd-4cfe-9257-39b66d6ac63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3b4aa1-e3fd-4cfe-9257-39b66d6ac63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-714301488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe43df12-82dc-4abb-84ae-3322f40e22e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd38c125242aeb38b2e0045c259fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:15Z,use_quota=True,user_id='3a439558a96f4f1cb4724c6b29238d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7427f9d5-3a89-4e21-91e4-64a6c9accd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7427f9d5-3a89-4e21-91e4-64a6c9accd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3092361a-32e7-4c17-806b-a6b7fcd6337c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3092361a-32e7-4c17-806b-a6b7fcd6337c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe43df12-82dc-4abb-84ae-3322f40e22e3', 'volume_name': 'volume-fe43df12-82dc-4abb-84ae-3322f40e22e3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e87c517-aae5-433d-889a-4ce31445df28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e87c517-aae5-433d-889a-4ce31445df28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b490eb74-7e49-4a1b-aa0b-68a2581fcd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:14 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Volume fe43df12-82dc-4abb-84ae-3322f40e22e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe43df12-82dc-4abb-84ae-3322f40e22e3', 'volume_size': 1} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-714301488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe43df12-82dc-4abb-84ae-3322f40e22e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd38c125242aeb38b2e0045c259fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:15Z,use_quota=True,user_id='3a439558a96f4f1cb4724c6b29238d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Creating volume fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:00:14 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:00:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:14 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 1073741824 Apr 24 20:00:14 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:15 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 1073741824" returned: 0 in 0.785s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:15 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 Apr 24 20:00:15 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:16 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3" returned: 0 in 0.561s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:00:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b490eb74-7e49-4a1b-aa0b-68a2581fcd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe43df12-82dc-4abb-84ae-3322f40e22e3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c3442c-4e7b-4271-878b-90d6ebce6f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:16 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Volume volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 (fe43df12-82dc-4abb-84ae-3322f40e22e3): created successfully Apr 24 20:00:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c3442c-4e7b-4271-878b-90d6ebce6f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (7a0497d4-ef44-4d6a-8d0b-519712676889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:00:16 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-21e3d9ac-f267-404b-ace0-a668195a8f78 tempest-VolumesSnapshotTestJSON-575565307 None] Created volume successfully. Apr 24 20:00:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Creating offline snapshot a6c68198-f06d-4711-92cb-ec5e357e69df of volume fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:00:17 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e61dcc0-7d95-4d97-b0ba-6abe336cacec]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:17 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 Apr 24 20:00:17 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:18 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3" returned: 0 in 0.778s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:18 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df 1G Apr 24 20:00:18 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:18 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df 1G" returned: 0 in 0.844s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:18 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df Apr 24 20:00:18 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:19 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:19 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df is being set with open permissions: ugo+rw Apr 24 20:00:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:19 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df Apr 24 20:00:19 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:19 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df" returned: 0 in 0.542s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:20 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.info Apr 24 20:00:20 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:20 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.info" returned: 0 in 0.456s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:20 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.info is being set with open permissions: ugo+rw Apr 24 20:00:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:20 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.info Apr 24 20:00:20 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:21 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.info" returned: 0 in 0.600s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.885s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:21 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-9792bd47-d97f-42b9-aae9-0f9fcea8fea0 tempest-VolumesSnapshotTestJSON-575565307 None] Create snapshot completed successfully Apr 24 20:00:21 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:00:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (a9b653af-2097-455b-80a6-82f7709076b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:00:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d711af7-8994-49bd-814b-d34824c75c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d711af7-8994-49bd-814b-d34824c75c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1792772515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1651a15-4b6b-44c5-93e8-2684ca6f9dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd38c125242aeb38b2e0045c259fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a6c68198-f06d-4711-92cb-ec5e357e69df,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:22Z,use_quota=True,user_id='3a439558a96f4f1cb4724c6b29238d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339a3f76-a442-47d7-a197-51a92aeb0790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339a3f76-a442-47d7-a197-51a92aeb0790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fa46ca-57de-4480-825e-1c9e62f67d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fa46ca-57de-4480-825e-1c9e62f67d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f1651a15-4b6b-44c5-93e8-2684ca6f9dfd', 'volume_name': 'volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd', 'volume_size': 2, 'snapshot_id': 'a6c68198-f06d-4711-92cb-ec5e357e69df'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6cf36-0d73-47d1-9fbc-1a5cac57aed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6cf36-0d73-47d1-9fbc-1a5cac57aed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ba5de4-88bf-464a-a624-2c0a25e669d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:22 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Volume f1651a15-4b6b-44c5-93e8-2684ca6f9dfd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd', 'volume_size': 2, 'snapshot_id': 'a6c68198-f06d-4711-92cb-ec5e357e69df'} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-a6c68198-f06d-4711-92cb-ec5e357e69df-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" by "_create_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-a6c68198-f06d-4711-92cb-ec5e357e69df-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Creating volume f1651a15-4b6b-44c5-93e8-2684ca6f9dfd from snapshot a6c68198-f06d-4711-92cb-ec5e357e69df {{(pid=81641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] snapshot: a6c68198-f06d-4711-92cb-ec5e357e69df, volume: f1651a15-4b6b-44c5-93e8-2684ca6f9dfd, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d50053c-c099-4eb9-8f51-478cfc11ad8e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:22 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df Apr 24 20:00:22 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:22 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df" returned: 0 in 0.669s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe43df12-82dc-4abb-84ae-3322f40e22e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5dd8c-8bbb-44cd-8720-91de54419e82]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:22 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 Apr 24 20:00:22 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:23 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3" returned: 0 in 0.575s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:23 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 20:00:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:23 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd Apr 24 20:00:23 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bc44f7e5-6cce-46d7-959a-50628e922316 tempest-VolumesActionsTest-1573217736 None] Acquiring lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a" by "attach_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bc44f7e5-6cce-46d7-959a-50628e922316 tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a" acquired by "attach_volume" :: waited 0.074s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-bc44f7e5-6cce-46d7-959a-50628e922316 tempest-VolumesActionsTest-1573217736 None] Attaching volume 2aefd9cf-ec70-42d7-9285-bf87058d107a to instance a1cff6ef-b999-4a0c-bd68-5e89e4e2bc0c at mountpoint /dev/vdb on host None. Apr 24 20:00:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-bc44f7e5-6cce-46d7-959a-50628e922316 tempest-VolumesActionsTest-1573217736 None] Attach volume completed successfully. Apr 24 20:00:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bc44f7e5-6cce-46d7-959a-50628e922316 tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a" released by "attach_volume" :: held 0.299s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1416396b-3c1b-4a78-8a96-27e81eb147c5 tempest-VolumesActionsTest-1573217736 None] Acquiring lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a-detach_volume" by "detach_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1416396b-3c1b-4a78-8a96-27e81eb147c5 tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a-detach_volume" acquired by "detach_volume" :: waited 0.077s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1416396b-3c1b-4a78-8a96-27e81eb147c5 tempest-VolumesActionsTest-1573217736 None] Detaching volume 2aefd9cf-ec70-42d7-9285-bf87058d107a from instance a1cff6ef-b999-4a0c-bd68-5e89e4e2bc0c. Apr 24 20:00:31 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1416396b-3c1b-4a78-8a96-27e81eb147c5 tempest-VolumesActionsTest-1573217736 None] Detach volume completed successfully. Apr 24 20:00:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1416396b-3c1b-4a78-8a96-27e81eb147c5 tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a-detach_volume" released by "detach_volume" :: held 0.254s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:32 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" returned: 0 in 8.670s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:32 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2599a995-b5da-4836-ae64-aebb7be34a6f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:32 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 Apr 24 20:00:32 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:33 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3" returned: 0 in 0.902s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3, size 1024.00 MB, duration 8.67 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:00:33 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Converted 1024.00 MB image at 118.08 MB/s Apr 24 20:00:33 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd is being set with open permissions: ugo+rw Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:33 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd Apr 24 20:00:33 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:33 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" returned: 0 in 0.702s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" released by "_copy_volume_from_snapshot" :: held 11.624s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-a6c68198-f06d-4711-92cb-ec5e357e69df-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" released by "_create_volume_from_snapshot" :: held 11.681s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.700s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ba5de4-88bf-464a-a624-2c0a25e669d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd', 'volume_size': 2, 'snapshot_id': 'a6c68198-f06d-4711-92cb-ec5e357e69df'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463ed4a1-eee8-4641-87d3-17640570e027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:33 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Volume volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd (f1651a15-4b6b-44c5-93e8-2684ca6f9dfd): created successfully Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463ed4a1-eee8-4641-87d3-17640570e027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:33 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (a9b653af-2097-455b-80a6-82f7709076b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:00:33 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-698ef303-ff5d-48ca-9846-6318864f46f3 tempest-VolumesSnapshotTestJSON-575565307 None] Created volume successfully. Apr 24 20:00:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:34 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[22868286-bd05-48de-9e46-88036b436b8b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:34 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd Apr 24 20:00:34 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:35 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" returned: 0 in 0.651s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:35 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd Apr 24 20:00:35 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:35 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" returned: 0 in 0.531s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd" released by "delete_volume" :: held 1.222s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Created reservations ['f894d351-d759-4df2-880e-82b804893f15', '60bd5cfb-9b2d-4867-9f2f-4a4091606e76', 'bbade4a7-8002-4db6-9be2-eb872eaa32f5', '93fa97bf-5d2c-4154-a2e4-b6103cd8b064'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:35 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:00:35 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:36 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.549s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:00:36 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Deleted volume successfully. Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57bae6ca-ab46-4651-b4a7-c4bf648b302a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-f1651a15-4b6b-44c5-93e8-2684ca6f9dfd-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-a6c68198-f06d-4711-92cb-ec5e357e69df-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-a6c68198-f06d-4711-92cb-ec5e357e69df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-fe43df12-82dc-4abb-84ae-3322f40e22e3" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-fe43df12-82dc-4abb-84ae-3322f40e22e3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-a6c68198-f06d-4711-92cb-ec5e357e69df" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-a6c68198-f06d-4711-92cb-ec5e357e69df" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Deleting offline snapshot a6c68198-f06d-4711-92cb-ec5e357e69df of volume fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] snapshot_file for this snap is: volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3522de10-9858-442b-a5c5-14faa30138e5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:36 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df Apr 24 20:00:36 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:37 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df" returned: 0 in 0.632s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe43df12-82dc-4abb-84ae-3322f40e22e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:00:37 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ca2e01-6f99-4bc0-8710-58a481f0f5f3]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:37 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 Apr 24 20:00:37 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:38 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3" returned: 0 in 0.632s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:38 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df Apr 24 20:00:38 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:38 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df" returned: 0 in 0.572s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:38 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df Apr 24 20:00:38 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:39 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3.a6c68198-f06d-4711-92cb-ec5e357e69df" returned: 0 in 0.599s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-a6c68198-f06d-4711-92cb-ec5e357e69df" released by "_delete_snapshot" :: held 2.572s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-fe43df12-82dc-4abb-84ae-3322f40e22e3" released by "delete_snapshot" :: held 2.605s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:39 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Created reservations ['d457c4d4-d20a-4d8d-a9a5-e28fafe4d311', 'f51112f6-14d8-4df2-a619-329bcd6cde8d', 'f8e820ed-4583-4b78-9b94-2144b55cc7ad', '3929bc8b-0d3d-4bc8-b9e4-bdf14a395220'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:00:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Delete snapshot completed successfully. Apr 24 20:00:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b333a864-1b08-4168-bbab-309c06fb9e81 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-a6c68198-f06d-4711-92cb-ec5e357e69df-delete_snapshot" released by "delete_snapshot" :: held 2.767s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-fe43df12-82dc-4abb-84ae-3322f40e22e3-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-fe43df12-82dc-4abb-84ae-3322f40e22e3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-fe43df12-82dc-4abb-84ae-3322f40e22e3" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-fe43df12-82dc-4abb-84ae-3322f40e22e3" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[69035362-1c8b-4464-8bba-5b80fb98a397]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:40 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 Apr 24 20:00:40 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[30666921-993c-4239-aa20-6153646c7db7]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:40 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a Apr 24 20:00:40 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:40 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3" returned: 0 in 0.635s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:40 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3 Apr 24 20:00:40 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:41 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a" returned: 0 in 0.686s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[879979a0-01c1-4230-86ac-4be2eedd368f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:41 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a Apr 24 20:00:41 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:41 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-fe43df12-82dc-4abb-84ae-3322f40e22e3" returned: 0 in 0.506s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-fe43df12-82dc-4abb-84ae-3322f40e22e3" released by "delete_volume" :: held 1.212s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Created reservations ['0fc919df-d489-47e3-a229-42a8b811562f', '38bc450c-ad02-4f7e-bfc2-016088179ab0', '1da0d74b-1ddc-4157-a996-c000ca43b1da', 'faa3414e-2de8-45eb-89f9-e30eeef311e0'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:41 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:00:41 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:41 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a" returned: 0 in 0.689s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.810d2032-c996-4ee9-bd63-c5996fe199d9i_34zr73.img {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:41 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.810d2032-c996-4ee9-bd63-c5996fe199d9i_34zr73.img Apr 24 20:00:41 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:42 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.569s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:42 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:00:42 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Deleted volume successfully. Apr 24 20:00:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-29e86253-2de7-4013-8884-d1a71753a6d3 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-fe43df12-82dc-4abb-84ae-3322f40e22e3-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:00:43 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:00:43 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (70e41754-62a3-46d1-8ccd-066615ad1b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38889c65-a611-4192-b9dc-d17966f1d8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38889c65-a611-4192-b9dc-d17966f1d8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-741752840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f652454b-1900-40fa-8299-b5fe637e79dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd38c125242aeb38b2e0045c259fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:44Z,use_quota=True,user_id='3a439558a96f4f1cb4724c6b29238d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35719d41-4561-41e8-b5fc-3342bbde9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35719d41-4561-41e8-b5fc-3342bbde9559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d728f3a-f449-48b4-8c6e-3e9bd3a37e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d728f3a-f449-48b4-8c6e-3e9bd3a37e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f652454b-1900-40fa-8299-b5fe637e79dc', 'volume_name': 'volume-f652454b-1900-40fa-8299-b5fe637e79dc', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97653ff-1e18-4747-9e40-3998608741ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97653ff-1e18-4747-9e40-3998608741ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b05baa-696e-4645-a9df-7deb8e21bf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:44 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Volume f652454b-1900-40fa-8299-b5fe637e79dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f652454b-1900-40fa-8299-b5fe637e79dc', 'volume_size': 1} Apr 24 20:00:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Flow 'volume_create_manager' (040201a6-0255-476c-85fe-f83d82eb1fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e36703-466a-4190-92db-3957e297fa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e36703-466a-4190-92db-3957e297fa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-130675594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efec09b5-d47c-413a-b2d1-a3f4d7c671b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8ce021c8164c67bdf2f82ce8f4960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:45Z,use_quota=True,user_id='117ef76ff84b4939af47cc94d448d2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f44723-b557-479f-b778-390a597d736e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f44723-b557-479f-b778-390a597d736e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38650d02-c61e-482a-a37e-445356bff5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38650d02-c61e-482a-a37e-445356bff5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efec09b5-d47c-413a-b2d1-a3f4d7c671b0', 'volume_name': 'volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2486b741-f273-4eab-8826-f17be608180a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2486b741-f273-4eab-8826-f17be608180a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5517ca-50a8-495c-86ab-3198b17ad57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:00:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Volume efec09b5-d47c-413a-b2d1-a3f4d7c671b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0', 'volume_size': 1} Apr 24 20:00:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:47 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.810d2032-c996-4ee9-bd63-c5996fe199d9i_34zr73.img" returned: 0 in 5.460s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:47 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f70b26b-7f27-4ca8-848c-f64d0710a287]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:00:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:47 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a Apr 24 20:00:47 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:47 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a" returned: 0 in 0.649s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:47 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.810d2032-c996-4ee9-bd63-c5996fe199d9i_34zr73.img {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:00:47 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Converted 1024.00 MB image at 187.52 MB/s Apr 24 20:00:48 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] 810d2032-c996-4ee9-bd63-c5996fe199d9 was raw, no need to convert to raw {{(pid=81641) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 24 20:00:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 20:00:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:00:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:00:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:00:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:00:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:00:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:00:53 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:00:53 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:00:53 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 24 20:00:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.506s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:00:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:00:59 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=75,cinder:UPDATE=72,cinder:DELETE=5,cinder:INSERT=22 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 20:00:59 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:UPDATE=74,cinder:INSERT=15,cinder:SELECT=71,cinder:DELETE=6 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.942s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Uploaded volume to glance image-id: 810d2032-c996-4ee9-bd63-c5996fe199d9. {{(pid=81641) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.219s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-741752840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f652454b-1900-40fa-8299-b5fe637e79dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd38c125242aeb38b2e0045c259fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:44Z,use_quota=True,user_id='3a439558a96f4f1cb4724c6b29238d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Creating volume f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:03 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:03 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e8f38484-0aeb-42d6-b45b-bb4b7726e50f tempest-VolumesActionsTest-1573217736 None] Copy volume to image completed successfully. Apr 24 20:01:03 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc 1073741824 Apr 24 20:01:03 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:04 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc 1073741824" returned: 0 in 0.603s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:04 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc Apr 24 20:01:04 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:04 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc" returned: 0 in 0.521s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-130675594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efec09b5-d47c-413a-b2d1-a3f4d7c671b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8ce021c8164c67bdf2f82ce8f4960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:00:45Z,use_quota=True,user_id='117ef76ff84b4939af47cc94d448d2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Creating volume efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:04 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b05baa-696e-4645-a9df-7deb8e21bf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f652454b-1900-40fa-8299-b5fe637e79dc', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:04 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 1073741824 Apr 24 20:01:04 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bb5c81-c166-4e77-a351-07d6a6f7e12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:04 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Volume volume-f652454b-1900-40fa-8299-b5fe637e79dc (f652454b-1900-40fa-8299-b5fe637e79dc): created successfully Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bb5c81-c166-4e77-a351-07d6a6f7e12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (70e41754-62a3-46d1-8ccd-066615ad1b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:04 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4a9e5c70-670a-48ec-81ff-797542b6003a tempest-VolumesSnapshotTestJSON-575565307 None] Created volume successfully. Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:05 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 1073741824" returned: 0 in 0.676s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:05 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 Apr 24 20:01:05 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:05 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" returned: 0 in 0.411s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.702s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9540b73f-86db-4341-996b-db76d1e61615]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5517ca-50a8-495c-86ab-3198b17ad57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1c6d15-7ec8-407d-9760-d3c30bb9bf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:05 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Volume volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 (efec09b5-d47c-413a-b2d1-a3f4d7c671b0): created successfully Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1c6d15-7ec8-407d-9760-d3c30bb9bf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:05 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Flow 'volume_create_manager' (040201a6-0255-476c-85fe-f83d82eb1fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:05 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-0848bb5f-e010-403b-a620-10f4e18bf62e tempest-SnapshotDependencyTests-448734710 None] Created volume successfully. Apr 24 20:01:05 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a Apr 24 20:01:05 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:06 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a" returned: 0 in 0.510s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:06 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f426df23-82b5-4251-9e28-0dedeba99a8e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:06 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a Apr 24 20:01:06 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:06 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a" returned: 0 in 0.525s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:06 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img Apr 24 20:01:06 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:10 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img" returned: 0 in 4.047s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:10 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[24419fc4-b761-4d1a-8f72-b7e19271ce90]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:10 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a Apr 24 20:01:10 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:11 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a" returned: 0 in 0.606s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:11 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:01:11 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Converted 1024.00 MB image at 252.95 MB/s Apr 24 20:01:11 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] e07fcce4-0063-43b6-b465-f7277feb1260 was raw, converting to qcow2 {{(pid=81641) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 24 20:01:11 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbac756-2157-4746-ad55-374adfed84aa]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:11 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img Apr 24 20:01:11 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:11 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img" returned: 0 in 0.455s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:12 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img Apr 24 20:01:12 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:12 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img" returned: 1 in 0.462s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 20:01:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img /opt/stack/data/cinder/conversion/vol_upload_ihps8usj {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:12 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img /opt/stack/data/cinder/conversion/vol_upload_ihps8usj Apr 24 20:01:12 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:12 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img /opt/stack/data/cinder/conversion/vol_upload_ihps8usj" returned: 0 in 0.434s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:12 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Image conversion details: src /opt/stack/data/cinder/conversion/2aefd9cf-ec70-42d7-9285-bf87058d107a.temp_image.e07fcce4-0063-43b6-b465-f7277feb1260xbfypne5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ihps8usj {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:01:12 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 24 20:01:12 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc285ab-f6bc-46ac-9efc-c49b5fa53420]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ihps8usj {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:12 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ihps8usj Apr 24 20:01:12 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:13 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ihps8usj" returned: 0 in 0.476s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.692s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Uploaded volume to glance image-id: e07fcce4-0063-43b6-b465-f7277feb1260. {{(pid=81641) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 20:01:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.144s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Creating offline snapshot af2df04d-8e5b-49e8-851d-41293ba26f46 of volume f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:01:14 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6106863f-cbf9-4871-be8d-2bc621b9cf72 tempest-VolumesActionsTest-1573217736 None] Copy volume to image completed successfully. Apr 24 20:01:14 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[604be881-8349-4394-8ed9-d4ea1eb7996a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:14 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc Apr 24 20:01:14 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:14 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc" returned: 0 in 0.498s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:14 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 1G Apr 24 20:01:14 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:15 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 1G" returned: 0 in 0.571s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f652454b-1900-40fa-8299-b5fe637e79dc -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:15 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f652454b-1900-40fa-8299-b5fe637e79dc -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 Apr 24 20:01:15 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Acquiring lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Acquiring lock "cinder-quobyte-2aefd9cf-ec70-42d7-9285-bf87058d107a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Lock "cinder-quobyte-2aefd9cf-ec70-42d7-9285-bf87058d107a" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[712941fe-c980-4777-b751-8a460357429d]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:16 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f652454b-1900-40fa-8299-b5fe637e79dc -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46" returned: 0 in 0.523s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:16 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 is being set with open permissions: ugo+rw Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:16 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 Apr 24 20:01:16 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:16 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a Apr 24 20:01:16 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:16 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46" returned: 0 in 0.426s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:16 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a" returned: 0 in 0.505s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:16 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.info Apr 24 20:01:16 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:16 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a Apr 24 20:01:16 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:16 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.info" returned: 0 in 0.419s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:16 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.info is being set with open permissions: ugo+rw Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:16 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2aefd9cf-ec70-42d7-9285-bf87058d107a" returned: 0 in 0.418s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:16 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.info Apr 24 20:01:16 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Lock "cinder-quobyte-2aefd9cf-ec70-42d7-9285-bf87058d107a" released by "delete_volume" :: held 0.964s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Created reservations ['63fc9356-a71c-4a63-ad35-5694e73630ea', '636e7469-4728-4a85-8a75-c7a00693c26c', '323f40f1-c0a0-4b9a-8a77-94835ac2c156', 'fbaa7904-5b91-4625-8440-0c7ce2345d0c'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:17 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:01:17 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:17 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.info" returned: 0 in 0.422s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.946s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.546s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Creating offline snapshot 59d8eef0-d051-45a8-aeca-f0b3b9c97c92 of volume efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcef8d73-f3d5-4aba-a60b-e72e85bc8226]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:17 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-fc704666-bebb-43e9-8919-15c84a841332 tempest-VolumesSnapshotTestJSON-575565307 None] Create snapshot completed successfully Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:17 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 Apr 24 20:01:17 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:17 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.427s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:01:17 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Deleted volume successfully. Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9918b0db-02a2-4f6e-974c-3d74f615fea8 tempest-VolumesActionsTest-1573217736 None] Lock "cinder-2aefd9cf-ec70-42d7-9285-bf87058d107a-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:17 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" returned: 0 in 0.518s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:17 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 1G Apr 24 20:01:17 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (9f0fc89b-55d5-49ff-9166-7d14efd82445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d3554c-8863-4abd-9df3-9b74294aa0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d3554c-8863-4abd-9df3-9b74294aa0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1356489161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1156ee9-ee61-4b2a-85f7-25a5fd38c00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51fd38c125242aeb38b2e0045c259fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=af2df04d-8e5b-49e8-851d-41293ba26f46,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:18Z,use_quota=True,user_id='3a439558a96f4f1cb4724c6b29238d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33d5ffe-edcb-42e8-b409-12006560d1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33d5ffe-edcb-42e8-b409-12006560d1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50395ebe-dfaf-406c-af07-c69f7b09bfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50395ebe-dfaf-406c-af07-c69f7b09bfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f1156ee9-ee61-4b2a-85f7-25a5fd38c00c', 'volume_name': 'volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c', 'volume_size': 1, 'snapshot_id': 'af2df04d-8e5b-49e8-851d-41293ba26f46'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4112d772-1986-471e-b971-796aef0befb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4112d772-1986-471e-b971-796aef0befb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bd3d7a-a82d-46b0-9c7b-2f2d4815e3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:18 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Volume f1156ee9-ee61-4b2a-85f7-25a5fd38c00c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c', 'volume_size': 1, 'snapshot_id': 'af2df04d-8e5b-49e8-851d-41293ba26f46'} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:18 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 1G" returned: 0 in 0.605s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:18 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 Apr 24 20:01:18 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:19 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92" returned: 0 in 0.503s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:19 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 is being set with open permissions: ugo+rw Apr 24 20:01:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:19 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 Apr 24 20:01:19 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:19 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92" returned: 0 in 0.456s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:19 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.info Apr 24 20:01:19 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:19 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.info" returned: 0 in 0.429s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:19 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.info is being set with open permissions: ugo+rw Apr 24 20:01:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:19 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.info Apr 24 20:01:19 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:20 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.info" returned: 0 in 0.463s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.063s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.248s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-af2df04d-8e5b-49e8-851d-41293ba26f46-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" by "_create_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-af2df04d-8e5b-49e8-851d-41293ba26f46-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Creating volume f1156ee9-ee61-4b2a-85f7-25a5fd38c00c from snapshot af2df04d-8e5b-49e8-851d-41293ba26f46 {{(pid=81641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e92be5b3-5c16-4822-b14b-6a16eb9770f1 tempest-SnapshotDependencyTests-448734710 None] Create snapshot completed successfully Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] snapshot: af2df04d-8e5b-49e8-851d-41293ba26f46, volume: f1156ee9-ee61-4b2a-85f7-25a5fd38c00c, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f4bc6-b32c-468c-a9f4-03962211bf86]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:20 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 Apr 24 20:01:20 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:21 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46" returned: 0 in 0.565s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f652454b-1900-40fa-8299-b5fe637e79dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc8fd0-fcdf-495e-bdaa-762fdba37f40]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:21 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc Apr 24 20:01:21 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:21 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc" returned: 0 in 0.609s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:21 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c Apr 24 20:01:21 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Flow 'volume_create_manager' (77826fb2-db79-4055-9e25-601a91be8124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0775e808-cc58-4337-a238-6ddd469c0a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0775e808-cc58-4337-a238-6ddd469c0a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b974958-5c0f-4e7b-a47b-b97a6d2d13a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8ce021c8164c67bdf2f82ce8f4960d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59d8eef0-d051-45a8-aeca-f0b3b9c97c92,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:22Z,use_quota=True,user_id='117ef76ff84b4939af47cc94d448d2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6977579-a499-4cf5-ad4a-44251d27bf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6977579-a499-4cf5-ad4a-44251d27bf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8d341c-2fd9-41ff-9461-98018ceedaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8d341c-2fd9-41ff-9461-98018ceedaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b974958-5c0f-4e7b-a47b-b97a6d2d13a3', 'volume_name': 'volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3', 'volume_size': 1, 'snapshot_id': '59d8eef0-d051-45a8-aeca-f0b3b9c97c92'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ef8116-9401-4cc7-a7af-511f1b1162d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ef8116-9401-4cc7-a7af-511f1b1162d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3574b040-1b60-478d-8cf3-8aa4eb8bc083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:21 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Volume 5b974958-5c0f-4e7b-a47b-b97a6d2d13a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3', 'volume_size': 1, 'snapshot_id': '59d8eef0-d051-45a8-aeca-f0b3b9c97c92'} Apr 24 20:01:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Flow 'volume_create_manager' (68b70e90-b070-4f39-a979-525ae9a20692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbce22c-030a-44a9-b2f1-0fab3a9c136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbce22c-030a-44a9-b2f1-0fab3a9c136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-851616731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1601fad3-a8eb-4861-976f-6d10c18e47be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b214fe3b55940dc927f6ed3a29bbc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:25Z,use_quota=True,user_id='a2651aa9f5594f5dba0c204507b2e698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96b0251-80f3-44f1-acb4-2dc4fbe2d0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96b0251-80f3-44f1-acb4-2dc4fbe2d0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d38e13a-c176-4d18-913c-d12285b42c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.image.glance [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Creating Keystone auth plugin from conf {{(pid=81641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d38e13a-c176-4d18-913c-d12285b42c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1601fad3-a8eb-4861-976f-6d10c18e47be', 'volume_name': 'volume-1601fad3-a8eb-4861-976f-6d10c18e47be', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eff92b9-07c8-4fd0-be49-9d448407905a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eff92b9-07c8-4fd0-be49-9d448407905a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95bdb91-0bfa-4fe9-a887-f819bf6403d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:25 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Volume 1601fad3-a8eb-4861-976f-6d10c18e47be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1601fad3-a8eb-4861-976f-6d10c18e47be', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 20:01:25 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Trying to clone 1601fad3-a8eb-4861-976f-6d10c18e47be from image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]). {{(pid=81641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 20:01:26 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 20:01:26 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Image download 20.69 MB at 20.69 MB/s Apr 24 20:01:26 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[51107fbb-2105-45a2-bed3-7148b77a09fc]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:26 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD Apr 24 20:01:26 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:27 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:27 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" returned: 0 in 5.471s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Temporary image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 is fetched for user a2651aa9f5594f5dba0c204507b2e698. {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[254b47e2-9513-4a1c-92e3-790e5c91d743]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2301e1-f7ee-43f4-b643-68a5f1fc3fbc]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:27 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc Apr 24 20:01:27 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:27 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD Apr 24 20:01:27 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:27 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:27 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc" returned: 0 in 0.660s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:01:27 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Converted 1024.00 MB image at 187.12 MB/s Apr 24 20:01:27 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c is being set with open permissions: ugo+rw Apr 24 20:01:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:27 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c Apr 24 20:01:27 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:28 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" returned: 0 in 0.464s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" released by "_copy_volume_from_snapshot" :: held 7.887s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-af2df04d-8e5b-49e8-851d-41293ba26f46-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" released by "_create_volume_from_snapshot" :: held 7.958s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.983s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.446s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "cinder-quobyte-59d8eef0-d051-45a8-aeca-f0b3b9c97c92-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" by "_create_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-59d8eef0-d051-45a8-aeca-f0b3b9c97c92-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Creating volume 5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 from snapshot 59d8eef0-d051-45a8-aeca-f0b3b9c97c92 {{(pid=81641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "cinder-quobyte-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bd3d7a-a82d-46b0-9c7b-2f2d4815e3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c', 'volume_size': 1, 'snapshot_id': 'af2df04d-8e5b-49e8-851d-41293ba26f46'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329fba97-1da9-4d93-a2ba-a0b80cee62cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:28 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Volume volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c (f1156ee9-ee61-4b2a-85f7-25a5fd38c00c): created successfully Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329fba97-1da9-4d93-a2ba-a0b80cee62cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Flow 'volume_create_manager' (9f0fc89b-55d5-49ff-9166-7d14efd82445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] snapshot: 59d8eef0-d051-45a8-aeca-f0b3b9c97c92, volume: 5b974958-5c0f-4e7b-a47b-b97a6d2d13a3, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:28 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-59fd7df3-57ef-4951-a6f6-899507d1fad1 tempest-VolumesSnapshotTestJSON-575565307 None] Created volume successfully. Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[433a5af1-f799-42ca-bc2d-01f5bbe8bf2b]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:28 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 Apr 24 20:01:28 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b81a09-f8aa-41c8-b8e7-9ad203908d8e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:29 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c Apr 24 20:01:29 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:29 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92" returned: 0 in 0.581s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e471380f-fd48-49d3-82eb-b14cce19a7ae]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:29 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 Apr 24 20:01:29 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:29 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:29 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c Apr 24 20:01:29 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:29 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" returned: 0 in 0.535s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 20:01:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:29 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 Apr 24 20:01:29 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:30 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" returned: 0 in 0.501s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c" released by "delete_volume" :: held 1.084s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:30 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Created reservations ['60d455dc-0ec5-4306-8353-45b852ffbe27', 'fc1154df-2b7d-488a-8777-d5655b173ae6', '458fe6f0-10b5-4717-ad3e-87f3d8accc4d', '157736ae-6e44-4b00-8515-04d2e256eb07'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:01:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:30 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:01:30 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:31 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.950s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:01:31 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Deleted volume successfully. Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2a254458-5c1a-4ee7-98d9-b2eada4031b5 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-f1156ee9-ee61-4b2a-85f7-25a5fd38c00c-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-af2df04d-8e5b-49e8-851d-41293ba26f46-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-af2df04d-8e5b-49e8-851d-41293ba26f46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-f652454b-1900-40fa-8299-b5fe637e79dc" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f652454b-1900-40fa-8299-b5fe637e79dc" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-af2df04d-8e5b-49e8-851d-41293ba26f46" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-af2df04d-8e5b-49e8-851d-41293ba26f46" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Deleting offline snapshot af2df04d-8e5b-49e8-851d-41293ba26f46 of volume f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] snapshot_file for this snap is: volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b5d82-5ba4-42da-a151-a47a2c7ecec7]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:31 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 Apr 24 20:01:31 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:32 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46" returned: 0 in 0.844s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f652454b-1900-40fa-8299-b5fe637e79dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:01:32 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61bfc8b-0827-4498-8c6b-e2dee81caefb]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:32 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc Apr 24 20:01:32 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:33 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc" returned: 0 in 0.745s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:33 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 Apr 24 20:01:33 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:34 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46" returned: 0 in 1.035s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:34 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46 Apr 24 20:01:34 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:34 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc.af2df04d-8e5b-49e8-851d-41293ba26f46" returned: 0 in 0.647s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-af2df04d-8e5b-49e8-851d-41293ba26f46" released by "_delete_snapshot" :: held 3.437s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:34 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f652454b-1900-40fa-8299-b5fe637e79dc" released by "delete_snapshot" :: held 3.479s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" returned: 0 in 5.111s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49420fd-f344-4cfc-a221-0247ff74a6e8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Created reservations ['1007176e-4081-4afe-a8b6-241ddec9ddcc', '1e1dfda4-08b7-4cee-b7a2-7747934fc257', '5524c971-0df0-4af2-aacd-533f1eacca98', '601acf2c-67c4-4368-b768-c3bc060107a0'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:01:34 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 Apr 24 20:01:34 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:34 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Delete snapshot completed successfully. Apr 24 20:01:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f8f0a75e-41e4-4189-b400-5ece57e53774 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-af2df04d-8e5b-49e8-851d-41293ba26f46-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:35 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" returned: 0 in 0.681s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:01:35 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Converted 1024.00 MB image at 200.31 MB/s Apr 24 20:01:35 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 is being set with open permissions: ugo+rw Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:35 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 Apr 24 20:01:35 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-f652454b-1900-40fa-8299-b5fe637e79dc-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-f652454b-1900-40fa-8299-b5fe637e79dc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-f652454b-1900-40fa-8299-b5fe637e79dc" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f652454b-1900-40fa-8299-b5fe637e79dc" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a733d375-63f4-4f6e-a8a5-df0960dba542]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:35 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc Apr 24 20:01:35 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:35 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" returned: 0 in 0.461s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" released by "_copy_volume_from_snapshot" :: held 7.473s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-59d8eef0-d051-45a8-aeca-f0b3b9c97c92-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" released by "_create_volume_from_snapshot" :: held 7.530s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.561s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.181s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-851616731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1601fad3-a8eb-4861-976f-6d10c18e47be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b214fe3b55940dc927f6ed3a29bbc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:25Z,use_quota=True,user_id='a2651aa9f5594f5dba0c204507b2e698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Creating volume 1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:36 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:36 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be 1073741824 Apr 24 20:01:36 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3574b040-1b60-478d-8cf3-8aa4eb8bc083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3', 'volume_size': 1, 'snapshot_id': '59d8eef0-d051-45a8-aeca-f0b3b9c97c92'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd40610-fd3b-418f-97f7-9397f878d36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:36 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Volume volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 (5b974958-5c0f-4e7b-a47b-b97a6d2d13a3): created successfully Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd40610-fd3b-418f-97f7-9397f878d36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Flow 'volume_create_manager' (77826fb2-db79-4055-9e25-601a91be8124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:36 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-63a7be80-f51a-468e-bcec-1bdaec220009 tempest-SnapshotDependencyTests-448734710 None] Created volume successfully. Apr 24 20:01:36 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc" returned: 0 in 0.556s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:36 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc Apr 24 20:01:36 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:36 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be 1073741824" returned: 0 in 0.627s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:36 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be Apr 24 20:01:36 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:36 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-f652454b-1900-40fa-8299-b5fe637e79dc" returned: 0 in 0.463s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-f652454b-1900-40fa-8299-b5fe637e79dc" released by "delete_volume" :: held 1.089s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Created reservations ['03d7c6ae-db47-4cac-bb68-abe3e849616d', 'dd8a55c2-aa35-4f61-a300-70b0775e3de1', '0cd82c9c-1c8f-4dfc-9c94-0598bb30f167', '9ae3d1fd-93ec-439c-82c3-1fd1967ba4e6'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:36 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:01:36 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:37 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be" returned: 0 in 0.470s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Attempting download of 2f4436ec-2be7-46ed-af6e-ed3ceb305141 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}])) to volume 1601fad3-a8eb-4861-976f-6d10c18e47be. {{(pid=81641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb57873a-2795-4f2e-9fed-74fd9bebe134]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_opvkzzj3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "cinder-59d8eef0-d051-45a8-aeca-f0b3b9c97c92-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-59d8eef0-d051-45a8-aeca-f0b3b9c97c92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "cinder-quobyte-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "cinder-quobyte-59d8eef0-d051-45a8-aeca-f0b3b9c97c92" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-59d8eef0-d051-45a8-aeca-f0b3b9c97c92" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Deleting offline snapshot 59d8eef0-d051-45a8-aeca-f0b3b9c97c92 of volume efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] snapshot_file for this snap is: volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[444ccb01-e89d-496f-a2a4-9ee119673e81]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:37 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_opvkzzj3 Apr 24 20:01:37 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:37 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.473s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:01:37 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Deleted volume successfully. Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-046a3e9c-f29d-4a5e-a9c7-9576982c46ce tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-f652454b-1900-40fa-8299-b5fe637e79dc-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:37 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 Apr 24 20:01:37 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:37 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_opvkzzj3" returned: 0 in 0.543s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_opvkzzj3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:37 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_opvkzzj3 Apr 24 20:01:37 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:37 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92" returned: 0 in 0.557s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f0345d-d1bf-4398-b8c8-0a540aa71bf8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-05a74a90-bc48-4a6e-8228-dd40a3ddb152-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-05a74a90-bc48-4a6e-8228-dd40a3ddb152-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "cinder-quobyte-05a74a90-bc48-4a6e-8228-dd40a3ddb152" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:38 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 Apr 24 20:01:38 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-05a74a90-bc48-4a6e-8228-dd40a3ddb152" acquired by "delete_volume" :: waited 0.027s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9354b6a7-243b-4632-b3ea-4dbd747ffb10]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:38 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 Apr 24 20:01:38 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:38 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_opvkzzj3" returned: 1 in 0.570s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f4436ec-2be7-46ed-af6e-ed3ceb305141_opvkzzj3' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd670a2a-fe13-40d6-a303-7f4ba7ced930]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:38 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD Apr 24 20:01:38 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:38 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" returned: 0 in 0.592s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:38 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 Apr 24 20:01:38 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:38 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:38 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152 Apr 24 20:01:38 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:38 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] 2f4436ec-2be7-46ed-af6e-ed3ceb305141 was qcow2, converting to raw {{(pid=81641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 20:01:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:38 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be Apr 24 20:01:38 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:39 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-05a74a90-bc48-4a6e-8228-dd40a3ddb152" returned: 0 in 0.473s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:39 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-quobyte-05a74a90-bc48-4a6e-8228-dd40a3ddb152" released by "delete_volume" :: held 1.066s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92" returned: 0 in 0.610s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:39 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92 Apr 24 20:01:39 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Created reservations ['d0990238-e2bf-415e-98e0-ace05b647bb6', 'd3713c4f-0b6f-420a-a639-0aa1f5ae27b5', 'c34c9cd8-29f9-4834-b85e-c2222b3595af', 'c84c7504-4dd1-4b66-b362-5ad23b34a0ca'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:39 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:01:39 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:39 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0.59d8eef0-d051-45a8-aeca-f0b3b9c97c92" returned: 0 in 0.448s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-59d8eef0-d051-45a8-aeca-f0b3b9c97c92" released by "_delete_snapshot" :: held 2.320s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" released by "delete_snapshot" :: held 2.342s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Created reservations ['d016690d-6a8b-49f4-9cf5-0d81ca343ab1', '74d97a70-50a2-4fa4-a519-b50ec7e2639c', '7641ca58-ac07-4df7-aa16-c0b3f9e4512d', 'cdb1a220-e538-4057-95b5-2bf964c8ad05'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:01:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Delete snapshot completed successfully. Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b2b54660-f28a-4b93-8c5e-7c9e0f09732a tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-59d8eef0-d051-45a8-aeca-f0b3b9c97c92-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:39 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.540s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:01:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Deleted volume successfully. Apr 24 20:01:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3993a621-913b-45b1-acab-8a4ee3885ab4 tempest-VolumesSnapshotTestJSON-575565307 None] Lock "cinder-05a74a90-bc48-4a6e-8228-dd40a3ddb152-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:40 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be" returned: 0 in 1.486s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f4436ec-2be7-46ed-af6e-ed3ceb305141_s14ou7hudevstack@QuobyteHD, size 112.00 MB, duration 1.49 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:01:40 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Converted 112.00 MB image at 75.32 MB/s Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:40 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be 1G Apr 24 20:01:40 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "cinder-efec09b5-d47c-413a-b2d1-a3f4d7c671b0-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-efec09b5-d47c-413a-b2d1-a3f4d7c671b0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "cinder-quobyte-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2bb015-2b83-4cbb-9985-14b267e08630]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:40 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 Apr 24 20:01:40 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:40 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be 1G" returned: 0 in 0.579s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[313ca711-26ab-499c-88d5-8e133e952013]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:40 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:41 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be Apr 24 20:01:41 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:41 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" returned: 0 in 0.594s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:41 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0 Apr 24 20:01:41 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:41 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:41 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be Apr 24 20:01:41 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:41 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-efec09b5-d47c-413a-b2d1-a3f4d7c671b0" released by "delete_volume" :: held 1.191s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Created reservations ['776df016-eef9-4066-9c6c-742215af7eac', 'cee50449-de8e-4101-95b2-a3b17dc74e69', 'fbb02166-b6e5-4655-b276-0f14110f778f', 'a5a19819-37e7-4785-b4ea-d6e62d275c6d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:41 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:01:41 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:42 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be" returned: 1 in 0.653s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Downloaded image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}])) to volume 1601fad3-a8eb-4861-976f-6d10c18e47be successfully. {{(pid=81641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Temporary image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 for user a2651aa9f5594f5dba0c204507b2e698 is deleted. {{(pid=81641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.volume.volume_utils [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Marking volume 1601fad3-a8eb-4861-976f-6d10c18e47be as bootable. {{(pid=81641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Copying metadata from image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 to 1601fad3-a8eb-4861-976f-6d10c18e47be. {{(pid=81641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Creating volume glance metadata for volume 1601fad3-a8eb-4861-976f-6d10c18e47be backed by image 2f4436ec-2be7-46ed-af6e-ed3ceb305141 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95bdb91-0bfa-4fe9-a887-f819bf6403d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1601fad3-a8eb-4861-976f-6d10c18e47be', 'volume_size': 1, 'image_id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb34368e7705449aba380cefa9c527b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f4436ec-2be7-46ed-af6e-ed3ceb305141', 'created_at': datetime.datetime(2026, 4, 24, 17, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f4436ec-2be7-46ed-af6e-ed3ceb305141/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ed4f6d-9950-40ba-979a-9c221596f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:42 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Volume volume-1601fad3-a8eb-4861-976f-6d10c18e47be (1601fad3-a8eb-4861-976f-6d10c18e47be): created successfully Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ed4f6d-9950-40ba-979a-9c221596f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Flow 'volume_create_manager' (68b70e90-b070-4f39-a979-525ae9a20692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:42 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-c8e2bdad-a2f4-4f68-b6a3-cd98d58e94d2 tempest-VolumesExtendTest-631923108 None] Created volume successfully. Apr 24 20:01:42 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.535s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:01:42 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Deleted volume successfully. Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-a29eec60-e937-45e5-86c7-85de5ed08f0e tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-efec09b5-d47c-413a-b2d1-a3f4d7c671b0-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "cinder-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "cinder-quobyte-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa8f315-7379-4fbb-a12f-4aaebd302479]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:42 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 Apr 24 20:01:42 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:43 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" returned: 0 in 0.661s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:43 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3 Apr 24 20:01:43 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:43 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af274e-ef3e-4984-869c-cb7d2f28ee44]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:43 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be Apr 24 20:01:43 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:44 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" returned: 0 in 0.582s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-quobyte-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3" released by "delete_volume" :: held 1.352s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Created reservations ['03d507c8-4fc9-450d-b3d7-886f3d35f291', '11c6729c-fee9-4d92-a682-3c18996551f8', '297b1b79-2ae3-4830-b21d-dae1b44619f7', 'c027c2c9-c576-4bf6-a35e-5f4fd45bfef9'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:01:44 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be" returned: 0 in 0.665s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:44 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:01:44 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:44 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be Apr 24 20:01:44 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:44 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.490s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:01:44 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Deleted volume successfully. Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-77fb01d2-eecf-4fcf-86f9-19cebcd07aaa tempest-SnapshotDependencyTests-448734710 None] Lock "cinder-5b974958-5c0f-4e7b-a47b-b97a6d2d13a3-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:44 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be" returned: 1 in 0.623s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be 2G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be 2G" returned: 0 in 0.101s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.445s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:45 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-54500fbe-fea4-4b69-9a2f-521e32bd4a19 tempest-VolumesExtendTest-631923108 None] Extend volume completed successfully. Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (e8286b36-52a0-4267-9c07-13c4d0adee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d487261-6f33-42ee-8c35-ad90d6f3f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d487261-6f33-42ee-8c35-ad90d6f3f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1971408043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75807ea8-fba9-4f62-b804-e6c1eb6072d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:46Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14b1af5-3f78-4375-aadb-db30052e034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14b1af5-3f78-4375-aadb-db30052e034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ec73a2-0b01-40a2-a2cc-6f8a3423c8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ec73a2-0b01-40a2-a2cc-6f8a3423c8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75807ea8-fba9-4f62-b804-e6c1eb6072d8', 'volume_name': 'volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb900a6-7612-4a60-9ea0-5b1c9cc64fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb900a6-7612-4a60-9ea0-5b1c9cc64fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3ba617-6eeb-4e58-a038-21d81c17ebdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume 75807ea8-fba9-4f62-b804-e6c1eb6072d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8', 'volume_size': 1} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1971408043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75807ea8-fba9-4f62-b804-e6c1eb6072d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:46Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Creating volume 75807ea8-fba9-4f62-b804-e6c1eb6072d8 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:45 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Acquiring lock "cinder-1601fad3-a8eb-4861-976f-6d10c18e47be-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:45 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 1073741824 Apr 24 20:01:46 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Lock "cinder-1601fad3-a8eb-4861-976f-6d10c18e47be-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Acquiring lock "cinder-quobyte-1601fad3-a8eb-4861-976f-6d10c18e47be" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Lock "cinder-quobyte-1601fad3-a8eb-4861-976f-6d10c18e47be" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:46 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2858bb-a5a3-427a-9f6c-a05bc8139939]: (4, 'raw') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:46 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be Apr 24 20:01:46 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:46 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 1073741824" returned: 0 in 0.717s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:46 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be" returned: 0 in 0.580s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:46 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 Apr 24 20:01:46 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:46 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be Apr 24 20:01:46 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:47 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8" returned: 0 in 0.471s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3ba617-6eeb-4e58-a038-21d81c17ebdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1c858f-fbc1-4164-9b45-1257260ad8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:47 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 (75807ea8-fba9-4f62-b804-e6c1eb6072d8): created successfully Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1c858f-fbc1-4164-9b45-1257260ad8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (e8286b36-52a0-4267-9c07-13c4d0adee79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:47 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f86f4550-3ea4-45b1-86aa-70db6ec083d9 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created volume successfully. Apr 24 20:01:47 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be" returned: 1 in 0.653s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be' failed. Not Retrying. {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:47 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be Apr 24 20:01:47 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:47 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1601fad3-a8eb-4861-976f-6d10c18e47be" returned: 0 in 0.490s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Lock "cinder-quobyte-1601fad3-a8eb-4861-976f-6d10c18e47be" released by "delete_volume" :: held 1.791s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Created reservations ['ac459701-d6d8-4153-9fb1-0221d69034b7', 'd3938b8a-7167-4af4-a4cb-d2afca36135c', '88193f89-a544-47f8-8426-80f9e7864cba', 'd7a67b60-071c-4063-97c3-572f9f33bad0'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:48 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:01:48 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Creating offline snapshot 474ce032-1f48-4fb3-be03-809a287e8ab9 of volume 75807ea8-fba9-4f62-b804-e6c1eb6072d8 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c53f39-4c90-4d9a-b77c-45771aa8d681]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:48 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 Apr 24 20:01:48 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:48 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.679s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:01:48 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Deleted volume successfully. Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Flow 'volume_create_manager' (eb08d7d0-e6e5-4196-b061-79dced43ce69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30793e59-c00c-44a6-9446-d1b0a016fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dfcc5205-f791-463d-b444-db2e4e073a26 tempest-VolumesExtendTest-631923108 None] Lock "cinder-1601fad3-a8eb-4861-976f-6d10c18e47be-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30793e59-c00c-44a6-9446-d1b0a016fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2096641103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1915298f-b6e0-4698-95c7-b7ceaef757b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b214fe3b55940dc927f6ed3a29bbc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:49Z,use_quota=True,user_id='a2651aa9f5594f5dba0c204507b2e698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886fc78a-fab0-4e3f-bb72-57b649a2f91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886fc78a-fab0-4e3f-bb72-57b649a2f91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe73081-aa12-492f-a0b1-da11636aa78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe73081-aa12-492f-a0b1-da11636aa78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1915298f-b6e0-4698-95c7-b7ceaef757b0', 'volume_name': 'volume-1915298f-b6e0-4698-95c7-b7ceaef757b0', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b725d00-a318-498d-abcb-8b8515e1fc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b725d00-a318-498d-abcb-8b8515e1fc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e6cd93-c76c-4f68-b433-dd78b9415e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:48 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Volume 1915298f-b6e0-4698-95c7-b7ceaef757b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1915298f-b6e0-4698-95c7-b7ceaef757b0', 'volume_size': 1} Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:48 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8" returned: 0 in 0.715s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:49 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 1G Apr 24 20:01:49 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:49 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 1G" returned: 0 in 0.707s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:49 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 Apr 24 20:01:49 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:50 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9" returned: 0 in 0.573s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:50 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 is being set with open permissions: ugo+rw Apr 24 20:01:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:50 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 Apr 24 20:01:50 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:50 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9" returned: 0 in 0.492s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:50 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.info Apr 24 20:01:50 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:51 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.info" returned: 0 in 0.455s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:51 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.info is being set with open permissions: ugo+rw Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:51 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.info Apr 24 20:01:51 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:51 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.info" returned: 0 in 0.530s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.574s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.034s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2096641103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1915298f-b6e0-4698-95c7-b7ceaef757b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b214fe3b55940dc927f6ed3a29bbc7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:49Z,use_quota=True,user_id='a2651aa9f5594f5dba0c204507b2e698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Creating volume 1915298f-b6e0-4698-95c7-b7ceaef757b0 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:51 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:51 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 1073741824 Apr 24 20:01:51 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:51 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d3249155-c772-43b9-b6c7-aceabd6655c4 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Create snapshot completed successfully Apr 24 20:01:52 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 1073741824" returned: 0 in 0.735s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:52 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 Apr 24 20:01:52 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (a7768e10-b73e-49a2-97c9-6587f68da6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1092cd23-d9c5-427f-9fd6-fd4e89231834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1092cd23-d9c5-427f-9fd6-fd4e89231834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372306962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32421bb8-4dbe-4f72-9170-a2bc19cea25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:53Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366b94a8-5258-47e6-a181-8cda297e3454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366b94a8-5258-47e6-a181-8cda297e3454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b162cdf4-3831-4e1d-83a9-fbeaecb58423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b162cdf4-3831-4e1d-83a9-fbeaecb58423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32421bb8-4dbe-4f72-9170-a2bc19cea25b', 'volume_name': 'volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649288d2-0c32-4ce4-952d-a8b5545ff602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649288d2-0c32-4ce4-952d-a8b5545ff602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cba3a5f-228c-42b1-8574-5bf60abc59ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume 32421bb8-4dbe-4f72-9170-a2bc19cea25b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b', 'volume_size': 1} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:53 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0" returned: 0 in 0.626s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.219s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372306962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32421bb8-4dbe-4f72-9170-a2bc19cea25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:53Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Creating volume 32421bb8-4dbe-4f72-9170-a2bc19cea25b {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:53 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e6cd93-c76c-4f68-b433-dd78b9415e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1915298f-b6e0-4698-95c7-b7ceaef757b0', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2c07a6-52de-4bfc-ae55-29c04d1042b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b 1073741824 Apr 24 20:01:53 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (f8a47fc4-d8d9-4bf5-8c57-9a914f800a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b315e9aa-d655-4b6e-910e-6d973ad1d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Volume volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 (1915298f-b6e0-4698-95c7-b7ceaef757b0): created successfully Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2c07a6-52de-4bfc-ae55-29c04d1042b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Flow 'volume_create_manager' (eb08d7d0-e6e5-4196-b061-79dced43ce69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:53 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-20e606d7-c461-479f-a06a-f16e6f8aa8df tempest-VolumesExtendTest-631923108 None] Created volume successfully. Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b315e9aa-d655-4b6e-910e-6d973ad1d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140951962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405fe283-8223-46c5-960b-ff9d12af8ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:53Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46f20b3-ce07-42bd-b596-3c63fa251c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46f20b3-ce07-42bd-b596-3c63fa251c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21172ac1-6cec-4ed0-9912-077b803ce264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21172ac1-6cec-4ed0-9912-077b803ce264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405fe283-8223-46c5-960b-ff9d12af8ed4', 'volume_name': 'volume-405fe283-8223-46c5-960b-ff9d12af8ed4', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908d7799-4e16-4783-83d7-3225e8b3d1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908d7799-4e16-4783-83d7-3225e8b3d1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d795b52e-06bd-4679-9f2f-06c0a0c676b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume 405fe283-8223-46c5-960b-ff9d12af8ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405fe283-8223-46c5-960b-ff9d12af8ed4', 'volume_size': 1} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (b84b0ed5-55f8-4c89-83a6-00986ed57b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab81303-6444-4223-919c-fd92ce86a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab81303-6444-4223-919c-fd92ce86a827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1737282093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c7ab94-1bff-4cd8-9872-653875317844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:54Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1c9daf-6899-4848-a9b1-d24807d30144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1c9daf-6899-4848-a9b1-d24807d30144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173821f5-55a3-4a66-ae18-974d1ccd328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173821f5-55a3-4a66-ae18-974d1ccd328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c7ab94-1bff-4cd8-9872-653875317844', 'volume_name': 'volume-14c7ab94-1bff-4cd8-9872-653875317844', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9f34b1-9cba-40c1-a7cf-9ec18f51a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9f34b1-9cba-40c1-a7cf-9ec18f51a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f148fa69-6beb-4faa-9a51-ad372f1bf331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume 14c7ab94-1bff-4cd8-9872-653875317844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c7ab94-1bff-4cd8-9872-653875317844', 'volume_size': 1} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (97f9c1f7-3c34-4ca4-9e49-b373d96f4e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e66abb-f82f-4324-9e39-09fd0771eae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e66abb-f82f-4324-9e39-09fd0771eae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-662130872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30276b2f-307f-41d2-9a8f-b237292b036b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:54Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f6c058-857d-43b4-8498-e4be3c55311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f6c058-857d-43b4-8498-e4be3c55311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50cdb82-22f9-4846-b4d1-f352353e8a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50cdb82-22f9-4846-b4d1-f352353e8a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30276b2f-307f-41d2-9a8f-b237292b036b', 'volume_name': 'volume-30276b2f-307f-41d2-9a8f-b237292b036b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6029cfd8-380a-4aa9-bdc1-e1c30ecd7b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6029cfd8-380a-4aa9-bdc1-e1c30ecd7b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c061230f-b31a-4e69-b424-68e3411f5d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:53 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume 30276b2f-307f-41d2-9a8f-b237292b036b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30276b2f-307f-41d2-9a8f-b237292b036b', 'volume_size': 1} Apr 24 20:01:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:54 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b 1073741824" returned: 0 in 0.958s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:54 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b Apr 24 20:01:54 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (668570ca-9819-4bf5-95bf-e527b1795bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e903257a-bdc4-4e0c-ae17-53c720386fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e903257a-bdc4-4e0c-ae17-53c720386fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832126493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37aaa3f4-f68b-4d91-ab96-6510a2b07920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:54Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2f26dd-eaed-4493-94f2-b6ae4339a198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2f26dd-eaed-4493-94f2-b6ae4339a198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b696e49-2af2-42bc-a327-2b7143e68cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b696e49-2af2-42bc-a327-2b7143e68cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37aaa3f4-f68b-4d91-ab96-6510a2b07920', 'volume_name': 'volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d4efe7-f37a-4bac-b3fa-ce2a78c74c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d4efe7-f37a-4bac-b3fa-ce2a78c74c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f333c53-42c0-49cc-b9e1-82af973be8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume 37aaa3f4-f68b-4d91-ab96-6510a2b07920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920', 'volume_size': 1} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:54 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b" returned: 0 in 0.582s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140951962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405fe283-8223-46c5-960b-ff9d12af8ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:53Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Creating volume 405fe283-8223-46c5-960b-ff9d12af8ed4 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:54 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cba3a5f-228c-42b1-8574-5bf60abc59ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca535dc8-9e9b-4104-8009-01074a5b7d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:54 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4 1073741824 Apr 24 20:01:54 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b (32421bb8-4dbe-4f72-9170-a2bc19cea25b): created successfully Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca535dc8-9e9b-4104-8009-01074a5b7d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (a7768e10-b73e-49a2-97c9-6587f68da6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:54 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-52e929ac-be0f-46d2-a0d6-fb9c31c5a394 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created volume successfully. Apr 24 20:01:55 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4 1073741824" returned: 0 in 0.668s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:55 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4 Apr 24 20:01:55 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:56 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4" returned: 0 in 0.480s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1737282093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c7ab94-1bff-4cd8-9872-653875317844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:54Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Creating volume 14c7ab94-1bff-4cd8-9872-653875317844 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:56 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d795b52e-06bd-4679-9f2f-06c0a0c676b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405fe283-8223-46c5-960b-ff9d12af8ed4', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29006ddf-e52f-44ef-b2a3-752c065644d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:56 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844 1073741824 Apr 24 20:01:56 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:56 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume volume-405fe283-8223-46c5-960b-ff9d12af8ed4 (405fe283-8223-46c5-960b-ff9d12af8ed4): created successfully Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29006ddf-e52f-44ef-b2a3-752c065644d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (f8a47fc4-d8d9-4bf5-8c57-9a914f800a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5040db0e-0c0a-437b-aa26-d1a4b007d386 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created volume successfully. Apr 24 20:01:56 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844 1073741824" returned: 0 in 0.668s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:56 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844 Apr 24 20:01:56 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:57 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844" returned: 0 in 0.455s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.258s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-662130872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30276b2f-307f-41d2-9a8f-b237292b036b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:54Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Creating volume 30276b2f-307f-41d2-9a8f-b237292b036b {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:57 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f148fa69-6beb-4faa-9a51-ad372f1bf331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c7ab94-1bff-4cd8-9872-653875317844', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:57 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b 1073741824 Apr 24 20:01:57 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d79e183-8615-405f-999f-f893f4997ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:57 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume volume-14c7ab94-1bff-4cd8-9872-653875317844 (14c7ab94-1bff-4cd8-9872-653875317844): created successfully Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d79e183-8615-405f-999f-f893f4997ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (b84b0ed5-55f8-4c89-83a6-00986ed57b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:57 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-c913f95d-c3bf-40fa-ac79-f3cc481c358a tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created volume successfully. Apr 24 20:01:57 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b 1073741824" returned: 0 in 0.633s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:57 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b Apr 24 20:01:57 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:58 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b" returned: 0 in 0.444s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.899s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832126493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37aaa3f4-f68b-4d91-ab96-6510a2b07920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5107b2b44064a8e9b8d4427e2df8fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:01:54Z,use_quota=True,user_id='ff13da16e2194404a53c24ff88347a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Creating volume 37aaa3f4-f68b-4d91-ab96-6510a2b07920 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:01:58 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c061230f-b31a-4e69-b424-68e3411f5d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30276b2f-307f-41d2-9a8f-b237292b036b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:58 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 1073741824 Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324ce144-08e0-43f7-b75c-cf61838200d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:58 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:58 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume volume-30276b2f-307f-41d2-9a8f-b237292b036b (30276b2f-307f-41d2-9a8f-b237292b036b): created successfully Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324ce144-08e0-43f7-b75c-cf61838200d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (97f9c1f7-3c34-4ca4-9e49-b373d96f4e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:58 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-ae066fa1-81d2-4511-8640-d7dd1e2433e5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created volume successfully. Apr 24 20:01:58 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 1073741824" returned: 0 in 0.630s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:59 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 Apr 24 20:01:59 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:59 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920" returned: 0 in 0.448s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.003s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:UPDATE=126,cinder:SELECT=93,cinder:INSERT=36,cinder:DELETE=12 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f333c53-42c0-49cc-b9e1-82af973be8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ff3461-f316-40f3-8510-b15ffe187e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=91,cinder:UPDATE=92,cinder:INSERT=26,cinder:DELETE=9 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Creating offline snapshot 106968cc-e001-4bb9-9c13-773020493b62 of volume 1915298f-b6e0-4698-95c7-b7ceaef757b0 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:01:59 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Volume volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 (37aaa3f4-f68b-4d91-ab96-6510a2b07920): created successfully Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ff3461-f316-40f3-8510-b15ffe187e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Flow 'volume_create_manager' (668570ca-9819-4bf5-95bf-e527b1795bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ff214a-e306-41db-8f87-578474696dff]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:01:59 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-9b9a1319-00c4-47bf-98d1-4d5b55ad964d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created volume successfully. Apr 24 20:01:59 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 Apr 24 20:01:59 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-37aaa3f4-f68b-4d91-ab96-6510a2b07920-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-37aaa3f4-f68b-4d91-ab96-6510a2b07920-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-quobyte-37aaa3f4-f68b-4d91-ab96-6510a2b07920" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-37aaa3f4-f68b-4d91-ab96-6510a2b07920" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e739a-47fb-4b9f-a354-5c5a6ea347b4]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:01:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:00 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 Apr 24 20:02:00 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:00 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0" returned: 0 in 0.545s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:00 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 1G Apr 24 20:02:00 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:00 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920" returned: 0 in 0.560s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:00 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920 Apr 24 20:02:00 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:00 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 1G" returned: 0 in 0.625s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:00 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 Apr 24 20:02:00 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:00 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37aaa3f4-f68b-4d91-ab96-6510a2b07920" returned: 0 in 0.436s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-37aaa3f4-f68b-4d91-ab96-6510a2b07920" released by "delete_volume" :: held 1.049s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created reservations ['a4f99fd3-9f2d-4afb-98e9-e92ba8ba94e4', '7379b91d-8056-4dfd-ac5f-90d904e8ce60', '8aa06055-86aa-422d-939c-af905986d702', 'cf835e37-132a-4f1b-bd42-14aee865b943'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:01 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:01 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:01 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62" returned: 0 in 0.527s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:01 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 is being set with open permissions: ugo+rw Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:01 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 Apr 24 20:02:01 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:01 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.458s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Deleted volume successfully. Apr 24 20:02:01 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62" returned: 0 in 0.449s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-262f7155-b899-43c5-9f6a-f58d9f2c239b tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-37aaa3f4-f68b-4d91-ab96-6510a2b07920-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:01 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.info Apr 24 20:02:01 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-30276b2f-307f-41d2-9a8f-b237292b036b-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-30276b2f-307f-41d2-9a8f-b237292b036b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:02 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.info" returned: 0 in 0.518s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:02 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.info is being set with open permissions: ugo+rw Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-quobyte-30276b2f-307f-41d2-9a8f-b237292b036b" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:02 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.info Apr 24 20:02:02 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-30276b2f-307f-41d2-9a8f-b237292b036b" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2cbd33-20cb-4409-b75c-339b0a9febe9]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:02 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b Apr 24 20:02:02 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:02 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.info" returned: 0 in 0.437s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.225s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:02 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-19175c0e-5b98-4972-b26d-539f612d3fa9 tempest-VolumesExtendTest-631923108 None] Create snapshot completed successfully Apr 24 20:02:02 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:02 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b Apr 24 20:02:02 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:03 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-30276b2f-307f-41d2-9a8f-b237292b036b" returned: 0 in 0.443s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-30276b2f-307f-41d2-9a8f-b237292b036b" released by "delete_volume" :: held 1.029s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created reservations ['b73a6365-a288-4947-bf48-b5410227a11e', 'a30ce563-c016-4ad0-bb16-5568431d12d1', '806f9a94-fdb9-43c7-8f2c-158b1b1ff70c', '9017b78b-e419-4627-98ea-940921d0f7e4'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:03 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:03 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6cddf522-e56c-4fae-8074-bf1a91a82f91 tempest-VolumesExtendTest-631923108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6cddf522-e56c-4fae-8074-bf1a91a82f91 tempest-VolumesExtendTest-631923108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc6c82-c858-4cdd-8710-102004a7ccd5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6cddf522-e56c-4fae-8074-bf1a91a82f91 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:03 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 Apr 24 20:02:03 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:03 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.489s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:03 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Deleted volume successfully. Apr 24 20:02:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-b02ce01f-d304-425d-9ff7-56dc873cee27 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-30276b2f-307f-41d2-9a8f-b237292b036b-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:04 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6cddf522-e56c-4fae-8074-bf1a91a82f91 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0" returned: 0 in 0.542s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6cddf522-e56c-4fae-8074-bf1a91a82f91 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 2G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-14c7ab94-1bff-4cd8-9872-653875317844-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-14c7ab94-1bff-4cd8-9872-653875317844-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-quobyte-14c7ab94-1bff-4cd8-9872-653875317844" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-14c7ab94-1bff-4cd8-9872-653875317844" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b42a473-2334-48e9-a61e-fc768d7d63b5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6cddf522-e56c-4fae-8074-bf1a91a82f91 tempest-VolumesExtendTest-631923108 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 2G" returned: 0 in 0.170s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6cddf522-e56c-4fae-8074-bf1a91a82f91 tempest-VolumesExtendTest-631923108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.746s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:04 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6cddf522-e56c-4fae-8074-bf1a91a82f91 tempest-VolumesExtendTest-631923108 None] Extend volume completed successfully. Apr 24 20:02:04 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844 Apr 24 20:02:04 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Acquiring lock "cinder-106968cc-e001-4bb9-9c13-773020493b62-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Lock "cinder-106968cc-e001-4bb9-9c13-773020493b62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Acquiring lock "cinder-quobyte-1915298f-b6e0-4698-95c7-b7ceaef757b0" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Lock "cinder-quobyte-1915298f-b6e0-4698-95c7-b7ceaef757b0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Acquiring lock "cinder-quobyte-106968cc-e001-4bb9-9c13-773020493b62" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Lock "cinder-quobyte-106968cc-e001-4bb9-9c13-773020493b62" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Deleting offline snapshot 106968cc-e001-4bb9-9c13-773020493b62 of volume 1915298f-b6e0-4698-95c7-b7ceaef757b0 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] snapshot_file for this snap is: volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:02:05 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063381d-b120-4021-9127-a0910ba961bd]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844" returned: 0 in 0.604s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:05 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844 Apr 24 20:02:05 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:05 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 Apr 24 20:02:05 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:05 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-14c7ab94-1bff-4cd8-9872-653875317844" returned: 0 in 0.468s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-14c7ab94-1bff-4cd8-9872-653875317844" released by "delete_volume" :: held 1.118s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:05 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created reservations ['e1fea220-c752-4b8f-a39d-974d8157e4f7', '4140c61c-152d-4b1f-8eb9-9c487a60cf4d', '7077113a-301e-4329-b8be-531ce8e11e49', '32e550fe-c1a0-4d11-96e6-547fc132edb5'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62" returned: 0 in 0.548s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1915298f-b6e0-4698-95c7-b7ceaef757b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[533ae7fd-11a0-4efa-9005-a4dba329df17]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:05 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 Apr 24 20:02:05 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:05 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:05 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:06 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.475s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:06 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Deleted volume successfully. Apr 24 20:02:06 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0" returned: 0 in 0.578s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-55d44432-6e0f-4b05-8bc4-fe7f2f2fe604 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-14c7ab94-1bff-4cd8-9872-653875317844-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:06 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 Apr 24 20:02:06 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-405fe283-8223-46c5-960b-ff9d12af8ed4-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-405fe283-8223-46c5-960b-ff9d12af8ed4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-quobyte-405fe283-8223-46c5-960b-ff9d12af8ed4" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-405fe283-8223-46c5-960b-ff9d12af8ed4" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b59dcd-e9d8-4aab-a4d4-ac70da446f52]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:06 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4 Apr 24 20:02:06 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:06 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62" returned: 0 in 0.616s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:06 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62 Apr 24 20:02:06 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:07 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4" returned: 0 in 0.556s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:07 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4 Apr 24 20:02:07 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:07 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0.106968cc-e001-4bb9-9c13-773020493b62" returned: 0 in 0.477s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Lock "cinder-quobyte-106968cc-e001-4bb9-9c13-773020493b62" released by "_delete_snapshot" :: held 2.328s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Lock "cinder-quobyte-1915298f-b6e0-4698-95c7-b7ceaef757b0" released by "delete_snapshot" :: held 2.356s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Created reservations ['495abaac-0479-4979-8913-d86dc8a028d0', '490e2bec-4903-4274-abca-b31ae8f30c41', 'c9445de2-f0c7-49d1-b275-a917713e7b62', '99f406cc-c8ed-4fad-8708-2804fe92822e'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:07 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Delete snapshot completed successfully. Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bab5eebd-8ce8-469d-be00-3e09c646a6ac tempest-VolumesExtendTest-631923108 None] Lock "cinder-106968cc-e001-4bb9-9c13-773020493b62-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:07 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-405fe283-8223-46c5-960b-ff9d12af8ed4" returned: 0 in 0.503s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-405fe283-8223-46c5-960b-ff9d12af8ed4" released by "delete_volume" :: held 1.101s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created reservations ['a79aaea3-02d8-4317-bcfb-13c58ab05ba2', 'cd71fc59-9f2b-4d8f-ae0b-960d4836f15a', '1311a683-99d0-4bdf-a2e8-71066579670d', '5cc35e29-e209-42c8-a6e2-3973e117f070'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:07 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:07 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Acquiring lock "cinder-1915298f-b6e0-4698-95c7-b7ceaef757b0-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Lock "cinder-1915298f-b6e0-4698-95c7-b7ceaef757b0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Acquiring lock "cinder-quobyte-1915298f-b6e0-4698-95c7-b7ceaef757b0" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Lock "cinder-quobyte-1915298f-b6e0-4698-95c7-b7ceaef757b0" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec86ff16-80bb-4967-8269-d9aae24630bb]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:08 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.497s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:08 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Deleted volume successfully. Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0aa9a7df-8ac5-46c5-be44-3126d5737fdf tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-405fe283-8223-46c5-960b-ff9d12af8ed4-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:08 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 Apr 24 20:02:08 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-32421bb8-4dbe-4f72-9170-a2bc19cea25b-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-32421bb8-4dbe-4f72-9170-a2bc19cea25b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:08 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:08 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0 Apr 24 20:02:08 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-quobyte-32421bb8-4dbe-4f72-9170-a2bc19cea25b" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-32421bb8-4dbe-4f72-9170-a2bc19cea25b" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9326e02e-72ae-4dc8-93e6-b8277fae01b5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:09 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b Apr 24 20:02:09 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:09 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1915298f-b6e0-4698-95c7-b7ceaef757b0" returned: 0 in 0.476s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Lock "cinder-quobyte-1915298f-b6e0-4698-95c7-b7ceaef757b0" released by "delete_volume" :: held 1.070s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Created reservations ['9787389e-ee5c-44df-b33f-9ac09d027148', 'c925de6c-9f75-4d33-acf5-eed64cd97a75', '216b3472-fc06-4d25-b36c-19f8003ed6ab', 'c7299e39-2524-4c4b-8f76-22a82e39afca'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:09 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b" returned: 0 in 0.540s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:09 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:09 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:09 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b Apr 24 20:02:09 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:10 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-32421bb8-4dbe-4f72-9170-a2bc19cea25b" returned: 0 in 0.434s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:10 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.461s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-32421bb8-4dbe-4f72-9170-a2bc19cea25b" released by "delete_volume" :: held 1.021s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Deleted volume successfully. Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-abb6f829-7ab0-4be3-9b00-11f87cc3a1b2 tempest-VolumesExtendTest-631923108 None] Lock "cinder-1915298f-b6e0-4698-95c7-b7ceaef757b0-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created reservations ['45d9f80e-5d99-4411-afce-c32296280447', '9339d602-0547-41c4-a5fb-91d0fa90b3c6', '96f4f6af-05d4-4e78-b7e7-31bd8db025b4', '0487e490-9212-4753-9b23-1a3a64be4f3c'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:10 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:10 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:10 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.455s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:10 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Deleted volume successfully. Apr 24 20:02:10 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6e658790-c027-4bf3-a6e3-d459f5b79e5d tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-32421bb8-4dbe-4f72-9170-a2bc19cea25b-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-474ce032-1f48-4fb3-be03-809a287e8ab9-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-474ce032-1f48-4fb3-be03-809a287e8ab9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-quobyte-75807ea8-fba9-4f62-b804-e6c1eb6072d8" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-75807ea8-fba9-4f62-b804-e6c1eb6072d8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-quobyte-474ce032-1f48-4fb3-be03-809a287e8ab9" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-474ce032-1f48-4fb3-be03-809a287e8ab9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Deleting offline snapshot 474ce032-1f48-4fb3-be03-809a287e8ab9 of volume 75807ea8-fba9-4f62-b804-e6c1eb6072d8 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] snapshot_file for this snap is: volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[94996d1e-e5da-4919-ac17-f0b49dd5c754]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:11 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 Apr 24 20:02:11 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:11 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9" returned: 0 in 0.546s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9906e99-0461-484a-9a95-15d035bca561]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:11 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 Apr 24 20:02:11 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:12 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8" returned: 0 in 0.613s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:12 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 Apr 24 20:02:12 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:13 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9" returned: 0 in 0.638s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:13 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9 Apr 24 20:02:13 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (c70869cf-769e-489b-9381-e94650c41c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a87e605-7028-4be0-8aed-f4efae548dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a87e605-7028-4be0-8aed-f4efae548dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590978096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5793f83d-1969-4bb0-b60b-4f4077210622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:13Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a1444f-9e26-4c05-99f6-5bb354faf589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a1444f-9e26-4c05-99f6-5bb354faf589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee42717-2fcf-4d1a-8358-e88efa12ff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee42717-2fcf-4d1a-8358-e88efa12ff8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5793f83d-1969-4bb0-b60b-4f4077210622', 'volume_name': 'volume-5793f83d-1969-4bb0-b60b-4f4077210622', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd04b10-0d84-41fe-9207-820d8db58f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd04b10-0d84-41fe-9207-820d8db58f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dcb2a8-4524-4633-b19d-1daac132f063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Volume 5793f83d-1969-4bb0-b60b-4f4077210622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5793f83d-1969-4bb0-b60b-4f4077210622', 'volume_size': 1} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590978096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5793f83d-1969-4bb0-b60b-4f4077210622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:13Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Creating volume 5793f83d-1969-4bb0-b60b-4f4077210622 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:13 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:13 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622 1073741824 Apr 24 20:02:13 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (bfd9b55c-1d95-444f-bfd6-02b49bd328c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664d6a33-38f7-4601-b1b8-a4982aa94161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664d6a33-38f7-4601-b1b8-a4982aa94161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844888354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:14Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77906a7c-5e65-42ac-b983-d28427721120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77906a7c-5e65-42ac-b983-d28427721120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b721107c-4818-4fb3-b9f2-4c095a48ecbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b721107c-4818-4fb3-b9f2-4c095a48ecbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3', 'volume_name': 'volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1f7fe8-6969-4c2b-81d7-59f1ca8cc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1f7fe8-6969-4c2b-81d7-59f1ca8cc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc36bce1-6012-4a54-af22-2b5c24d4f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Volume 6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3', 'volume_size': 1} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8.474ce032-1f48-4fb3-be03-809a287e8ab9" returned: 0 in 0.616s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-474ce032-1f48-4fb3-be03-809a287e8ab9" released by "_delete_snapshot" :: held 2.529s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-75807ea8-fba9-4f62-b804-e6c1eb6072d8" released by "delete_snapshot" :: held 2.556s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (0f235b62-fe28-4bf2-b040-a2064317fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62398b89-424e-4d8f-afd6-7fc4934752f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62398b89-424e-4d8f-afd6-7fc4934752f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708379679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce25e40-dcd6-405f-b177-7086b2066fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:14Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bea72d3-f9cb-47c4-ba4c-de7319ee22d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bea72d3-f9cb-47c4-ba4c-de7319ee22d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7b8e2c-bab4-4d53-9d75-84e8757aa8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7b8e2c-bab4-4d53-9d75-84e8757aa8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce25e40-dcd6-405f-b177-7086b2066fba', 'volume_name': 'volume-4ce25e40-dcd6-405f-b177-7086b2066fba', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04546ec9-1389-4d35-9d4f-ddefc1505f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04546ec9-1389-4d35-9d4f-ddefc1505f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e206beb-71d1-43e6-9002-d8b8a8c48b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:13 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Volume 4ce25e40-dcd6-405f-b177-7086b2066fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce25e40-dcd6-405f-b177-7086b2066fba', 'volume_size': 1} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:13 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created reservations ['b5b0f72c-e134-4b87-86a9-7293cab1941f', '6e209377-02e7-4ea1-a224-ffd77bf3c9a6', '40d91b3d-bb3c-4e7b-8f03-ca9519990dc5', '4c44a346-c8bb-43e5-9e9d-49ebb0ee983b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:13 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622 1073741824" returned: 0 in 0.725s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:14 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Delete snapshot completed successfully. Apr 24 20:02:14 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622 Apr 24 20:02:14 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-6f650436-c77e-4de2-a46c-c6bf50715635 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-474ce032-1f48-4fb3-be03-809a287e8ab9-delete_snapshot" released by "delete_snapshot" :: held 2.885s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (639504fe-cf5c-48b8-972a-c91cd23eb37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dcdbff-9747-4c3a-a47f-164a968599ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dcdbff-9747-4c3a-a47f-164a968599ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-39524588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:14Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c02de6-9c4c-4a3b-97b9-bc76986c3654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c02de6-9c4c-4a3b-97b9-bc76986c3654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89dcffc-32b6-48eb-ba23-af2e9a8d2c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89dcffc-32b6-48eb-ba23-af2e9a8d2c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a', 'volume_name': 'volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81bb5ab-9b94-4aef-8bfe-8de125ce2119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81bb5ab-9b94-4aef-8bfe-8de125ce2119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e46ce68-1847-406f-b603-c3ddd93fe254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Volume 37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a', 'volume_size': 1} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-75807ea8-fba9-4f62-b804-e6c1eb6072d8-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (2170c656-d8bb-4a0c-be51-7f571f6c4999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a34b57a-3709-416a-8b1a-d98826d29069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a34b57a-3709-416a-8b1a-d98826d29069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2113573009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9215c3-860c-46ff-932e-ad578e9c7b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:14Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7a9219-6949-47de-ae9f-550598610b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7a9219-6949-47de-ae9f-550598610b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc5f14a-ce7d-48e8-9672-c07a2fc7574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc5f14a-ce7d-48e8-9672-c07a2fc7574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9215c3-860c-46ff-932e-ad578e9c7b6a', 'volume_name': 'volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c7e22d-8d55-4a8c-8432-151a9e1703fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c7e22d-8d55-4a8c-8432-151a9e1703fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3166a7-ffb3-46ff-b8c9-88dfc3b34961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Volume eb9215c3-860c-46ff-932e-ad578e9c7b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a', 'volume_size': 1} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-75807ea8-fba9-4f62-b804-e6c1eb6072d8-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "cinder-quobyte-75807ea8-fba9-4f62-b804-e6c1eb6072d8" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-75807ea8-fba9-4f62-b804-e6c1eb6072d8" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e683270c-aab0-4e30-a31f-6d0a93ec2201]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:14 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622" returned: 0 in 0.536s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844888354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:14Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Creating volume 6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:14 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:14 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 1073741824 Apr 24 20:02:14 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dcb2a8-4524-4633-b19d-1daac132f063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5793f83d-1969-4bb0-b60b-4f4077210622', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e2aa21-c924-438d-87f9-9b0cf05c33eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:14 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Volume volume-5793f83d-1969-4bb0-b60b-4f4077210622 (5793f83d-1969-4bb0-b60b-4f4077210622): created successfully Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e2aa21-c924-438d-87f9-9b0cf05c33eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:14 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (c70869cf-769e-489b-9381-e94650c41c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:14 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 Apr 24 20:02:14 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:14 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e212d2de-1e53-4638-bb24-78a242d0f07b tempest-CreateVolumesFromImageTest-2113652292 None] Created volume successfully. Apr 24 20:02:15 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8" returned: 0 in 0.546s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:15 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8 Apr 24 20:02:15 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:15 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 1073741824" returned: 0 in 0.655s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:15 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 Apr 24 20:02:15 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:15 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-75807ea8-fba9-4f62-b804-e6c1eb6072d8" returned: 0 in 0.567s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:15 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-quobyte-75807ea8-fba9-4f62-b804-e6c1eb6072d8" released by "delete_volume" :: held 1.171s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3" returned: 0 in 0.428s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.765s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708379679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce25e40-dcd6-405f-b177-7086b2066fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:14Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Creating volume 4ce25e40-dcd6-405f-b177-7086b2066fba {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:15 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc36bce1-6012-4a54-af22-2b5c24d4f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:15 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba 1073741824 Apr 24 20:02:15 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29cdd2c-c790-415c-87f0-6c0771b5fe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:15 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Volume volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 (6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3): created successfully Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29cdd2c-c790-415c-87f0-6c0771b5fe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (bfd9b55c-1d95-444f-bfd6-02b49bd328c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:15 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-949c98cb-ce27-4508-8b0b-c386b2615d29 tempest-CreateVolumesFromImageTest-2113652292 None] Created volume successfully. Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Created reservations ['b4cb71e0-8c7b-4cc2-8e46-45a9b26a2339', '1ec61a3a-5468-4934-8f30-2eac37cf3ccc', 'cae63974-7ef5-47ec-a603-6056efa94e62', '9945d8e9-d888-45e8-acdb-d47b57f51324'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:15 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:15 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:16 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.495s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:16 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:16 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Deleted volume successfully. Apr 24 20:02:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2ffd8848-be6b-4cf7-bed7-13d14a37c7a5 tempest-CreateVolumesFromSnapshotTest-1228475719 None] Lock "cinder-75807ea8-fba9-4f62-b804-e6c1eb6072d8-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:16 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba 1073741824" returned: 0 in 0.699s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:16 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba Apr 24 20:02:16 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:16 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba" returned: 0 in 0.550s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.757s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-39524588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:14Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Creating volume 37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:17 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:17 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a 1073741824 Apr 24 20:02:17 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e206beb-71d1-43e6-9002-d8b8a8c48b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce25e40-dcd6-405f-b177-7086b2066fba', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8444756-e2c2-45ec-a766-6759bdebc151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:17 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Volume volume-4ce25e40-dcd6-405f-b177-7086b2066fba (4ce25e40-dcd6-405f-b177-7086b2066fba): created successfully Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8444756-e2c2-45ec-a766-6759bdebc151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (0f235b62-fe28-4bf2-b040-a2064317fd91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:17 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f55f28bd-74f7-45a3-8c79-411b3454fe5e tempest-CreateVolumesFromImageTest-2113652292 None] Created volume successfully. Apr 24 20:02:17 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a 1073741824" returned: 0 in 0.716s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:17 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a Apr 24 20:02:17 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:18 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a" returned: 0 in 0.497s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.808s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2113573009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9215c3-860c-46ff-932e-ad578e9c7b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ca14bc83ea741f19bb4695054af7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:14Z,use_quota=True,user_id='f7956bad6221443fa4f885b045b55777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Creating volume eb9215c3-860c-46ff-932e-ad578e9c7b6a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:18 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e46ce68-1847-406f-b603-c3ddd93fe254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:18 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a 1073741824 Apr 24 20:02:18 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ad9198-3e22-4e4d-ab79-f2230ebbb0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:18 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Volume volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a (37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a): created successfully Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ad9198-3e22-4e4d-ab79-f2230ebbb0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (639504fe-cf5c-48b8-972a-c91cd23eb37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:18 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4dc42c2c-1d4a-432a-b0f1-01c0009a557a tempest-CreateVolumesFromImageTest-2113652292 None] Created volume successfully. Apr 24 20:02:19 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a 1073741824" returned: 0 in 0.758s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:19 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a Apr 24 20:02:19 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Flow 'volume_create_manager' (4d4a6fd4-8a94-42ac-aa69-b02d20f4bec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0586f7f1-1615-472b-a222-d5f6395e0ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0586f7f1-1615-472b-a222-d5f6395e0ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357de685-3c82-4a3b-b875-3255a62a145b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3177678ac80146829da0fe35c195dcff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:19Z,use_quota=True,user_id='ef35160cab8f455db68ed69a284f221f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148936d3-7c77-4979-bc4c-a805100cb7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148936d3-7c77-4979-bc4c-a805100cb7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d49af2-745d-4a5b-949b-fcbbe4f52dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d49af2-745d-4a5b-949b-fcbbe4f52dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357de685-3c82-4a3b-b875-3255a62a145b', 'volume_name': 'volume-357de685-3c82-4a3b-b875-3255a62a145b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b498066e-1fae-4363-ac46-a9f36d8c27d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b498066e-1fae-4363-ac46-a9f36d8c27d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0556af1d-b9d2-444f-b2d0-e7c180694f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:19 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Volume 357de685-3c82-4a3b-b875-3255a62a145b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357de685-3c82-4a3b-b875-3255a62a145b', 'volume_size': 1} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:19 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a" returned: 0 in 0.502s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357de685-3c82-4a3b-b875-3255a62a145b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3177678ac80146829da0fe35c195dcff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:19Z,use_quota=True,user_id='ef35160cab8f455db68ed69a284f221f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Creating volume 357de685-3c82-4a3b-b875-3255a62a145b {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:19 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:19 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b 1073741824 Apr 24 20:02:19 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3166a7-ffb3-46ff-b8c9-88dfc3b34961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece24ea8-eabb-45b9-840a-467375fbaa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:19 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Volume volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a (eb9215c3-860c-46ff-932e-ad578e9c7b6a): created successfully Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece24ea8-eabb-45b9-840a-467375fbaa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Flow 'volume_create_manager' (2170c656-d8bb-4a0c-be51-7f571f6c4999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:19 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-87425333-4af4-4ded-a6b4-005441b4f9ff tempest-CreateVolumesFromImageTest-2113652292 None] Created volume successfully. Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-eb9215c3-860c-46ff-932e-ad578e9c7b6a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-eb9215c3-860c-46ff-932e-ad578e9c7b6a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-quobyte-eb9215c3-860c-46ff-932e-ad578e9c7b6a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-eb9215c3-860c-46ff-932e-ad578e9c7b6a" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bc6b7e-8c6e-4a07-9083-c6443bf3d6f7]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:20 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a Apr 24 20:02:20 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:20 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b 1073741824" returned: 0 in 0.709s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:20 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b Apr 24 20:02:20 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:20 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a" returned: 0 in 0.573s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:20 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a Apr 24 20:02:20 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:20 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b" returned: 0 in 0.458s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0556af1d-b9d2-444f-b2d0-e7c180694f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357de685-3c82-4a3b-b875-3255a62a145b', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42bec18-781c-41a2-80d2-9df77d14cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:20 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Volume volume-357de685-3c82-4a3b-b875-3255a62a145b (357de685-3c82-4a3b-b875-3255a62a145b): created successfully Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42bec18-781c-41a2-80d2-9df77d14cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Flow 'volume_create_manager' (4d4a6fd4-8a94-42ac-aa69-b02d20f4bec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d6a33d57-f6e4-49c6-8daa-a85a2c81fc74 tempest-CinderUnicodeTest-1210896428 None] Created volume successfully. Apr 24 20:02:21 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-eb9215c3-860c-46ff-932e-ad578e9c7b6a" returned: 0 in 0.474s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-eb9215c3-860c-46ff-932e-ad578e9c7b6a" released by "delete_volume" :: held 1.089s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Created reservations ['302b104f-96ca-4b48-ae0d-dbb3bb4a7e61', '504a3b1a-ce94-4eaf-bae0-a9c52a43bb85', 'ed2e892b-bf6c-4efc-8adc-912ff7bedce1', 'd437a721-5311-4be3-9d56-58f9d101255e'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:21 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:21 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Flow 'volume_create_manager' (f5082c9d-3edf-43e7-8cdf-689c95272612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ab2db9-5f16-4404-b64f-702a79ade628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:21 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.483s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ab2db9-5f16-4404-b64f-702a79ade628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-676700559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e991a4-300f-4940-a826-97cd60e88f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3177678ac80146829da0fe35c195dcff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:22Z,use_quota=True,user_id='ef35160cab8f455db68ed69a284f221f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fc32f9-4b3a-44d1-a1a6-80b176fe8415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fc32f9-4b3a-44d1-a1a6-80b176fe8415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1580af-e3d0-4e53-9f89-1fdb0307ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1580af-e3d0-4e53-9f89-1fdb0307ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e991a4-300f-4940-a826-97cd60e88f95', 'volume_name': 'volume-74e991a4-300f-4940-a826-97cd60e88f95', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e7863f-74f9-4773-a962-5e556dae9e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e7863f-74f9-4773-a962-5e556dae9e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d16a009-c28c-47d2-bbf7-6a71403a3d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:21 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Volume 74e991a4-300f-4940-a826-97cd60e88f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e991a4-300f-4940-a826-97cd60e88f95', 'volume_size': 1} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-676700559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e991a4-300f-4940-a826-97cd60e88f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3177678ac80146829da0fe35c195dcff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:22Z,use_quota=True,user_id='ef35160cab8f455db68ed69a284f221f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Creating volume 74e991a4-300f-4940-a826-97cd60e88f95 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:21 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:21 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Deleted volume successfully. Apr 24 20:02:21 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 1073741824 Apr 24 20:02:21 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e929a5b6-9d85-48d7-a51a-22c477b41dcb tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-eb9215c3-860c-46ff-932e-ad578e9c7b6a-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-quobyte-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d24d84-7f59-4bfa-870c-f0eaa98739b2]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:22 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a Apr 24 20:02:22 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:22 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 1073741824" returned: 0 in 0.723s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:22 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 Apr 24 20:02:22 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:22 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a" returned: 0 in 0.549s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:22 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a Apr 24 20:02:22 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:23 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95" returned: 0 in 0.456s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d16a009-c28c-47d2-bbf7-6a71403a3d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e991a4-300f-4940-a826-97cd60e88f95', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cefa162-969b-4c73-9862-cb88b6c775c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:23 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Volume volume-74e991a4-300f-4940-a826-97cd60e88f95 (74e991a4-300f-4940-a826-97cd60e88f95): created successfully Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cefa162-969b-4c73-9862-cb88b6c775c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Flow 'volume_create_manager' (f5082c9d-3edf-43e7-8cdf-689c95272612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:23 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-bb0e4ef2-4dd2-4f52-9b76-ac4e568b4bd5 tempest-CinderUnicodeTest-1210896428 None] Created volume successfully. Apr 24 20:02:23 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a" returned: 0 in 0.508s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a" released by "delete_volume" :: held 1.099s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Created reservations ['92a7384a-9cb3-448e-8272-0677e49a97bf', '85a2c36a-4697-4bb2-98e5-c710547a8565', 'abdc6b5e-a966-4cb4-b57d-6fffd7407387', '8c8a38ed-cced-4896-961b-7672abf8cc9e'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:23 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:23 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:24 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.503s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:24 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Deleted volume successfully. Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0e137ee5-7588-4402-aa14-c62f531f332b tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-37f1d5d5-85e7-4edf-8dbb-31fd8bb7584a-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Creating offline snapshot ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 of volume 74e991a4-300f-4940-a826-97cd60e88f95 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b0b68b-f1be-4c7f-a02c-fc56e85e800c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:24 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 Apr 24 20:02:24 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-4ce25e40-dcd6-405f-b177-7086b2066fba-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-4ce25e40-dcd6-405f-b177-7086b2066fba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-quobyte-4ce25e40-dcd6-405f-b177-7086b2066fba" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-4ce25e40-dcd6-405f-b177-7086b2066fba" acquired by "delete_volume" :: waited 0.027s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdf6c26-ac4b-40e9-92a1-0fa6fcaa30e6]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:24 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba Apr 24 20:02:24 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:24 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95" returned: 0 in 0.558s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:24 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 1G Apr 24 20:02:24 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:25 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba" returned: 0 in 0.519s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:25 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba Apr 24 20:02:25 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:25 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 1G" returned: 0 in 0.655s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e991a4-300f-4940-a826-97cd60e88f95 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:25 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e991a4-300f-4940-a826-97cd60e88f95 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 Apr 24 20:02:25 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:25 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4ce25e40-dcd6-405f-b177-7086b2066fba" returned: 0 in 0.491s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-4ce25e40-dcd6-405f-b177-7086b2066fba" released by "delete_volume" :: held 1.047s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Created reservations ['bb759a54-aa4c-40bb-90b5-f25592bded28', 'd505a752-8999-404b-8052-38bde3210aef', '4b031285-fb8d-4d7d-b05d-fd267929484b', 'ea607cad-aeb9-41e0-98ca-d4212177a908'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:25 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:25 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:25 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e991a4-300f-4940-a826-97cd60e88f95 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5" returned: 0 in 0.516s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:25 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 is being set with open permissions: ugo+rw Apr 24 20:02:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:25 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 Apr 24 20:02:25 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:26 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.517s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:26 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Deleted volume successfully. Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-5e3a0871-3770-40d8-a93e-f9ee41c4691f tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-4ce25e40-dcd6-405f-b177-7086b2066fba-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:26 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5" returned: 0 in 0.470s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:26 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.info Apr 24 20:02:26 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-quobyte-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3" acquired by "delete_volume" :: waited 0.013s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a7436c-e728-4593-a118-21e62fba0b3d]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:26 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 Apr 24 20:02:26 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:26 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.info" returned: 0 in 0.511s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:26 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.info is being set with open permissions: ugo+rw Apr 24 20:02:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:26 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.info Apr 24 20:02:26 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:27 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3" returned: 0 in 0.533s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:27 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3 Apr 24 20:02:27 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:27 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.info" returned: 0 in 0.490s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.284s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:27 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-560d1a79-828c-4a88-8d1c-a3d74edd2e74 tempest-CinderUnicodeTest-1210896428 None] Create snapshot completed successfully Apr 24 20:02:27 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3" returned: 0 in 0.475s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3" released by "delete_volume" :: held 1.050s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Created reservations ['b5016b75-db1d-483a-8209-4027a87ecd7e', '573ca40f-5ee5-414a-8255-85ffb99cbd2c', '9172c4ac-3c1d-486e-872f-561d17322ff7', '8be584fa-18ef-4f2c-9af3-d0704cd28f4f'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:27 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:27 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "cinder-ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "cinder-quobyte-74e991a4-300f-4940-a826-97cd60e88f95" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:28 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.452s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-quobyte-74e991a4-300f-4940-a826-97cd60e88f95" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "cinder-quobyte-ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:28 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Deleted volume successfully. Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-quobyte-ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Deleting offline snapshot ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 of volume 74e991a4-300f-4940-a826-97cd60e88f95 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] snapshot_file for this snap is: volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-57129df9-99d7-40aa-8573-7f72e0e7015c tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-6e4cecf8-8841-4cd3-ac50-6ca28bd2bdd3-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf8773-ce5a-4a79-a7d7-8672389d5aeb]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:28 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 Apr 24 20:02:28 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-5793f83d-1969-4bb0-b60b-4f4077210622-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-5793f83d-1969-4bb0-b60b-4f4077210622-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "cinder-quobyte-5793f83d-1969-4bb0-b60b-4f4077210622" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:28 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-5793f83d-1969-4bb0-b60b-4f4077210622" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5" returned: 0 in 0.586s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e991a4-300f-4940-a826-97cd60e88f95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[802ca275-229f-4ec0-b65d-d1f89e1ccd9c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1aeffb-8230-4b3d-968f-1e6c0988021a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:29 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622 Apr 24 20:02:29 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:29 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 Apr 24 20:02:29 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:29 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622" returned: 0 in 0.562s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:29 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622 Apr 24 20:02:29 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:29 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95" returned: 0 in 0.582s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:29 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 Apr 24 20:02:29 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:30 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-5793f83d-1969-4bb0-b60b-4f4077210622" returned: 0 in 0.434s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-quobyte-5793f83d-1969-4bb0-b60b-4f4077210622" released by "delete_volume" :: held 1.053s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Created reservations ['0dc1ce17-a172-4484-a625-581a4309832a', 'f83d6145-3308-4e19-a156-ad98365379be', 'fea6f99a-d535-43ec-a704-2890060ba34d', 'bef256ea-1601-4934-914d-2b611c14555b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:30 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5" returned: 0 in 0.579s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:30 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:30 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:30 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5 Apr 24 20:02:30 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:30 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.449s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Deleted volume successfully. Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-1ddfa6c0-45b0-42d4-bafd-af3ed32c2aea tempest-CreateVolumesFromImageTest-2113652292 None] Lock "cinder-5793f83d-1969-4bb0-b60b-4f4077210622-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:30 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95.ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5" returned: 0 in 0.494s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-quobyte-ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5" released by "_delete_snapshot" :: held 2.357s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-quobyte-74e991a4-300f-4940-a826-97cd60e88f95" released by "delete_snapshot" :: held 2.390s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Created reservations ['fefe993e-c602-40c3-b79e-fe350545cc9d', 'dc18e223-3ce3-4f81-814e-e2e5176210e2', 'dbc28c9b-d8e9-4aef-9eb0-1e802347ef89', '2588175d-916c-4fe2-9e79-6e5d20e8760a'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Delete snapshot completed successfully. Apr 24 20:02:30 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-398c9e23-3644-4a93-afb3-2c49e7a71fbf tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-ac58ab5d-9ff0-4cb9-9b36-faee726dfbd5-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "cinder-74e991a4-300f-4940-a826-97cd60e88f95-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-74e991a4-300f-4940-a826-97cd60e88f95-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "cinder-quobyte-74e991a4-300f-4940-a826-97cd60e88f95" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-quobyte-74e991a4-300f-4940-a826-97cd60e88f95" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:31 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0220cb-7df8-4ca2-94ac-4d9fdad67fd8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:31 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 Apr 24 20:02:31 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:32 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95" returned: 0 in 0.629s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:32 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95 Apr 24 20:02:32 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:32 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-74e991a4-300f-4940-a826-97cd60e88f95" returned: 0 in 0.517s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-quobyte-74e991a4-300f-4940-a826-97cd60e88f95" released by "delete_volume" :: held 1.206s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Created reservations ['2068d820-62f5-4697-b51b-0330bfa34ca9', '8fa9684a-4d59-45d6-986f-b915c52636f4', '370a4e16-4bb5-4d0f-a480-c6d0c6befd24', '5004475f-2cd7-4c11-b20a-49cb7918fe39'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:32 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:32 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:33 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.443s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:33 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:33 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Deleted volume successfully. Apr 24 20:02:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-bd8712d6-5c40-408d-b6fa-95195f4e771f tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-74e991a4-300f-4940-a826-97cd60e88f95-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "cinder-357de685-3c82-4a3b-b875-3255a62a145b-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-357de685-3c82-4a3b-b875-3255a62a145b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "cinder-quobyte-357de685-3c82-4a3b-b875-3255a62a145b" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-quobyte-357de685-3c82-4a3b-b875-3255a62a145b" acquired by "delete_volume" :: waited 0.012s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:33 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d238a46-5e58-4bea-bc9a-2d89a9fee305]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:33 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b Apr 24 20:02:33 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:34 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b" returned: 0 in 0.520s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:34 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b Apr 24 20:02:34 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:34 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-357de685-3c82-4a3b-b875-3255a62a145b" returned: 0 in 0.415s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-quobyte-357de685-3c82-4a3b-b875-3255a62a145b" released by "delete_volume" :: held 0.971s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Created reservations ['87f64447-9daa-4fd7-ab73-d5b131bf2d74', '45774c99-c108-427f-9556-32119efe2bfc', 'aab4e078-67af-4993-9557-e316a3627740', 'efa370d5-330b-4ce6-ae87-53d0f3c92fa7'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:34 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:34 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:35 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.422s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:35 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:35 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Deleted volume successfully. Apr 24 20:02:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2128c20a-f076-458b-be34-f4eef8501228 tempest-CinderUnicodeTest-1210896428 None] Lock "cinder-357de685-3c82-4a3b-b875-3255a62a145b-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Flow 'volume_create_manager' (ad907ded-3188-47f7-bba7-aa65009b95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a76f6f-6e4d-4c23-aec9-25b6f51508d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (e5c65a0d-34df-4bbb-9f3a-36db8763d0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6aec9-912a-45ed-8f47-8dfb6c4b0f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a76f6f-6e4d-4c23-aec9-25b6f51508d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-155254682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda2c9b4608447af86208785d95abce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='c44d87d57d614ae4bc45de35a9b44f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0ef1b4-b811-4584-8723-92cb45c93d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0ef1b4-b811-4584-8723-92cb45c93d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc372234-08dc-4b25-bd42-3e1bbf5936a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc372234-08dc-4b25-bd42-3e1bbf5936a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927', 'volume_name': 'volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b002d052-b784-4c2e-9783-08497caa92e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b002d052-b784-4c2e-9783-08497caa92e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6720e58c-7478-49c0-b5ca-744b0532a472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:44 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Volume e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927', 'volume_size': 1} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-155254682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda2c9b4608447af86208785d95abce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='c44d87d57d614ae4bc45de35a9b44f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Creating volume e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:44 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:44 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 1073741824 Apr 24 20:02:44 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6aec9-912a-45ed-8f47-8dfb6c4b0f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-597395989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea84921d-0dab-4d5f-af85-4fcb3bcf7110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d55115-4348-4aa2-a8d8-161b9b1eef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d55115-4348-4aa2-a8d8-161b9b1eef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ebba15-73a4-44ac-9ce5-e1a7f844367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ebba15-73a4-44ac-9ce5-e1a7f844367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea84921d-0dab-4d5f-af85-4fcb3bcf7110', 'volume_name': 'volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cd9c0e-df44-4c96-8c07-b320b90f1d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cd9c0e-df44-4c96-8c07-b320b90f1d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6049c6f1-0fe0-4e53-9bfc-f22445470a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Volume ea84921d-0dab-4d5f-af85-4fcb3bcf7110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110', 'volume_size': 1} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (ba790eaa-0985-41aa-8255-335f6c8fee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcb9541-d667-4c4e-b677-b2d06eceb211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcb9541-d667-4c4e-b677-b2d06eceb211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1929194392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a5757d-9eba-42c2-b60e-38961a82b272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a5757d-9eba-42c2-b60e-38961a82b272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510b0cff-59b9-4860-9f3e-552efcb8e67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510b0cff-59b9-4860-9f3e-552efcb8e67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab', 'volume_name': 'volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36653a20-afb1-47c7-8253-9723a7aa834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36653a20-afb1-47c7-8253-9723a7aa834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3072eea-524e-403e-9a87-9d5c1ac17791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Volume 0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab', 'volume_size': 1} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (ea2ab3a2-19e1-4f69-8b71-734f93c19f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed23b122-31f6-46af-ab46-44e5524a688a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed23b122-31f6-46af-ab46-44e5524a688a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-265509035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f438c842-031b-4fcd-8b0b-0f27229c7985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f438c842-031b-4fcd-8b0b-0f27229c7985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c001453d-53ce-4e45-b4e4-0af99b085189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c001453d-53ce-4e45-b4e4-0af99b085189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56', 'volume_name': 'volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f856e5ed-9f58-42cd-863f-a44b3ec3af42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f856e5ed-9f58-42cd-863f-a44b3ec3af42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd7bf38-3e3a-4531-b65d-861d53e26d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume 8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56', 'volume_size': 1} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (e4ef62ad-e25b-42a8-ad87-6b9bf7a9a997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057e5e2e-80e6-44ce-b97c-d9f876799b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057e5e2e-80e6-44ce-b97c-d9f876799b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38470216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0eff62-11f6-4f42-83cb-bab8d8706eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b26ee23-4c9b-4cd9-a200-54b6bae36370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b26ee23-4c9b-4cd9-a200-54b6bae36370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02985cc4-3d13-4617-a09a-0141354b5998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02985cc4-3d13-4617-a09a-0141354b5998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0eff62-11f6-4f42-83cb-bab8d8706eaa', 'volume_name': 'volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a1412c-8ae9-421c-9102-6a52d55ac26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a1412c-8ae9-421c-9102-6a52d55ac26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d80687-2973-4ab2-9c5a-a7b5b6c95db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Volume db0eff62-11f6-4f42-83cb-bab8d8706eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa', 'volume_size': 1} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:45 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (fb5e3656-1cad-4581-8af0-d8ff7702930d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf62f89f-6c6d-47b4-aa9f-aa5dd52d3561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf62f89f-6c6d-47b4-aa9f-aa5dd52d3561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1242757662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50da8c42-57b2-4a68-b6c5-6417375683be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:46Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e016274a-d3b8-41f1-bf9e-e4a2382bd6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e016274a-d3b8-41f1-bf9e-e4a2382bd6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961d81a3-a366-40fb-a4f5-824e4ab2c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961d81a3-a366-40fb-a4f5-824e4ab2c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50da8c42-57b2-4a68-b6c5-6417375683be', 'volume_name': 'volume-50da8c42-57b2-4a68-b6c5-6417375683be', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f888f3-2335-4770-8da8-4af81d2b1460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f888f3-2335-4770-8da8-4af81d2b1460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13009a47-1ade-4a66-bc46-053228cd4bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:45 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Volume 50da8c42-57b2-4a68-b6c5-6417375683be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50da8c42-57b2-4a68-b6c5-6417375683be', 'volume_size': 1} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 1073741824" returned: 0 in 1.094s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:46 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 Apr 24 20:02:46 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (0ace53cc-0a7f-4acd-9465-2735b9bfdd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3653ec5c-b3db-44dd-81e5-d36e05c1341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3653ec5c-b3db-44dd-81e5-d36e05c1341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1587328392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:46Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4684d4-7147-496c-be3e-64c40b4b4f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4684d4-7147-496c-be3e-64c40b4b4f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7cd5b0-02f0-4251-8c3f-16ddd233fe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7cd5b0-02f0-4251-8c3f-16ddd233fe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a', 'volume_name': 'volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcaf243-c68c-405a-8c72-cf125d561e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcaf243-c68c-405a-8c72-cf125d561e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cc8f80-a518-4d31-b445-f04b5adfae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:46 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Volume 96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a', 'volume_size': 1} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:46 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" returned: 0 in 0.521s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.478s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-597395989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea84921d-0dab-4d5f-af85-4fcb3bcf7110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Creating volume ea84921d-0dab-4d5f-af85-4fcb3bcf7110 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:46 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:46 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 1073741824 Apr 24 20:02:46 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6720e58c-7478-49c0-b5ca-744b0532a472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ab49c6-736d-4e63-b9c1-8092b36dafce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:46 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Volume volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 (e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927): created successfully Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ab49c6-736d-4e63-b9c1-8092b36dafce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:46 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Flow 'volume_create_manager' (ad907ded-3188-47f7-bba7-aa65009b95e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:46 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-fddcdc3f-1cbe-4130-890f-2e03893b82dd tempest-VolumeDependencyTests-1633329746 None] Created volume successfully. Apr 24 20:02:47 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 1073741824" returned: 0 in 0.728s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:47 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 Apr 24 20:02:47 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:47 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110" returned: 0 in 0.466s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1929194392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Creating volume 0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:47 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6049c6f1-0fe0-4e53-9bfc-f22445470a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22a3e33-c741-4771-95e1-028726fc55ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:47 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab 1073741824 Apr 24 20:02:47 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:47 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Volume volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 (ea84921d-0dab-4d5f-af85-4fcb3bcf7110): created successfully Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22a3e33-c741-4771-95e1-028726fc55ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:47 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (e5c65a0d-34df-4bbb-9f3a-36db8763d0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:47 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-47a78ed4-f5d8-445f-b06c-7de13cf73103 tempest-CreateVolumesFromImageTest-652110745 None] Created volume successfully. Apr 24 20:02:48 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab 1073741824" returned: 0 in 0.699s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:48 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab Apr 24 20:02:48 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:49 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab" returned: 0 in 0.541s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.617s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-265509035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Creating volume 8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:49 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3072eea-524e-403e-9a87-9d5c1ac17791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cb0e16-782a-4aff-ad4a-a99b14cba4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:49 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 1073741824 Apr 24 20:02:49 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:49 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Volume volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab (0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab): created successfully Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cb0e16-782a-4aff-ad4a-a99b14cba4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (ba790eaa-0985-41aa-8255-335f6c8fee03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:49 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1fd5ab3f-b2fd-4624-98b2-686041c1cfe6 tempest-CreateVolumesFromImageTest-652110745 None] Created volume successfully. Apr 24 20:02:49 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 1073741824" returned: 0 in 0.764s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:49 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 Apr 24 20:02:49 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:50 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" returned: 0 in 0.476s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.773s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38470216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0eff62-11f6-4f42-83cb-bab8d8706eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:45Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Creating volume db0eff62-11f6-4f42-83cb-bab8d8706eaa {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:50 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd7bf38-3e3a-4531-b65d-861d53e26d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:50 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa 1073741824 Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371f24a4-4064-447e-bc35-a5fac7253caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:50 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:50 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 (8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56): created successfully Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371f24a4-4064-447e-bc35-a5fac7253caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:50 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (ea2ab3a2-19e1-4f69-8b71-734f93c19f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:50 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-9a5d5112-71f7-4bf9-a1df-ceb8ee94ee3c tempest-CreateVolumesFromSnapshotTest-43736758 None] Created volume successfully. Apr 24 20:02:51 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa 1073741824" returned: 0 in 0.678s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:51 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa Apr 24 20:02:51 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:51 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa" returned: 0 in 0.509s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.604s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1242757662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50da8c42-57b2-4a68-b6c5-6417375683be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:46Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Creating volume 50da8c42-57b2-4a68-b6c5-6417375683be {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:51 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d80687-2973-4ab2-9c5a-a7b5b6c95db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbdca12-b61b-4553-b383-35cc7032c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:51 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be 1073741824 Apr 24 20:02:51 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:51 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Volume volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa (db0eff62-11f6-4f42-83cb-bab8d8706eaa): created successfully Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbdca12-b61b-4553-b383-35cc7032c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (e4ef62ad-e25b-42a8-ad87-6b9bf7a9a997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:51 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-eed44dea-acdd-40b1-95ed-e862039f608f tempest-CreateVolumesFromImageTest-652110745 None] Created volume successfully. Apr 24 20:02:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:52 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be 1073741824" returned: 0 in 0.772s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:52 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be Apr 24 20:02:52 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:52 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be" returned: 0 in 0.487s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.572s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1587328392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8fb8c6e794221983d4142b44bfdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:46Z,use_quota=True,user_id='1cb310acc62f47a6b912aea54fc75db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Creating volume 96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:02:52 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13009a47-1ade-4a66-bc46-053228cd4bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50da8c42-57b2-4a68-b6c5-6417375683be', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:52 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a 1073741824 Apr 24 20:02:52 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c27596-75b4-4f32-9332-a889ae900a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:52 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Volume volume-50da8c42-57b2-4a68-b6c5-6417375683be (50da8c42-57b2-4a68-b6c5-6417375683be): created successfully Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c27596-75b4-4f32-9332-a889ae900a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (fb5e3656-1cad-4581-8af0-d8ff7702930d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:52 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-24571d95-f4dd-4790-ba70-27f49e9da8f5 tempest-CreateVolumesFromImageTest-652110745 None] Created volume successfully. Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:53 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:53 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:53 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.462s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:53 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a 1073741824" returned: 0 in 0.704s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:53 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a Apr 24 20:02:53 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:54 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a" returned: 0 in 0.517s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.735s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Creating offline snapshot 09c12261-41ca-44a5-9683-dfcc15d678d5 of volume e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cc8f80-a518-4d31-b445-f04b5adfae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320d726a-5af6-43f9-a1a4-34e08bc8e598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f735d3-f265-403f-ab21-a2b6dd84e559]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Volume volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a (96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a): created successfully Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320d726a-5af6-43f9-a1a4-34e08bc8e598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Flow 'volume_create_manager' (0ace53cc-0a7f-4acd-9465-2735b9bfdd35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:54 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-10e7e7cb-07d7-4eb1-92c7-549c8db7a8c5 tempest-CreateVolumesFromImageTest-652110745 None] Created volume successfully. Apr 24 20:02:54 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 Apr 24 20:02:54 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:54 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" returned: 0 in 0.493s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:54 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 1G Apr 24 20:02:54 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-quobyte-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a" acquired by "delete_volume" :: waited 0.042s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e069e5f8-30fa-4cd0-b2f7-379db73cc4f1]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:55 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a Apr 24 20:02:55 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:55 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 1G" returned: 0 in 0.719s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:55 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 Apr 24 20:02:55 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:55 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a" returned: 0 in 0.568s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:55 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a Apr 24 20:02:55 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:55 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5" returned: 0 in 0.576s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:55 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 is being set with open permissions: ugo+rw Apr 24 20:02:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:56 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 Apr 24 20:02:56 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:56 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a" returned: 0 in 0.524s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a" released by "delete_volume" :: held 1.152s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Created reservations ['b5d0f12a-4db1-4312-bf59-aa88dc72d991', 'f3524a36-0b0b-47ee-a721-6cc746b715fa', 'e43d83ca-63b9-41aa-8e59-966bc08532a0', '25ea9fc6-3e25-43f0-8105-5e695fe45f5f'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:56 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:56 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:56 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5" returned: 0 in 0.553s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:56 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.info Apr 24 20:02:56 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:56 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.480s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Deleted volume successfully. Apr 24 20:02:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-9b42f3b8-632b-477f-b111-1630a128f04f tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-96e6e034-9e8d-4c3f-9b80-adbb99fc1d5a-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:57 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.info" returned: 0 in 0.628s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:57 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.info is being set with open permissions: ugo+rw Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:57 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.info Apr 24 20:02:57 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-50da8c42-57b2-4a68-b6c5-6417375683be-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-50da8c42-57b2-4a68-b6c5-6417375683be-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-quobyte-50da8c42-57b2-4a68-b6c5-6417375683be" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-50da8c42-57b2-4a68-b6c5-6417375683be" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c95865-5d61-4a84-8509-28d3464a8eec]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:57 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be Apr 24 20:02:57 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:57 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.info" returned: 0 in 0.611s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.696s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.131s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Creating offline snapshot 5e93c66a-c4e5-4fee-a9b7-b41547f64fec of volume 8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:02:57 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-270b5e58-b6ea-4015-bdd3-690c464d7984 tempest-VolumeDependencyTests-1633329746 None] Create snapshot completed successfully Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d12af7f-ce59-443c-a84b-9360bd1500aa]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:58 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 Apr 24 20:02:58 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:58 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be" returned: 0 in 0.628s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:58 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be Apr 24 20:02:58 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:58 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-50da8c42-57b2-4a68-b6c5-6417375683be" returned: 0 in 0.514s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:58 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" returned: 0 in 0.666s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-50da8c42-57b2-4a68-b6c5-6417375683be" released by "delete_volume" :: held 1.196s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:58 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec 1G Apr 24 20:02:58 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Created reservations ['4db5046f-218c-482e-bfe8-84ed5f42c666', 'bcc58675-ca86-4c81-8d21-bbcc11c19b68', '45a1ffb0-4e33-45db-a27b-607c70b26495', 'a2c46cb3-a541-44ee-8cd9-e457a9a1b519'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:02:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:58 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:02:58 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:59 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec 1G" returned: 0 in 0.701s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:59 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec Apr 24 20:02:59 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:59 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.662s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:02:59 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Deleted volume successfully. Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Flow 'volume_create_manager' (b0a449ca-5584-4a56-b8e5-473a1d1f6661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbc4ba5-4fc8-4611-9e9c-482661a9ae51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbc4ba5-4fc8-4611-9e9c-482661a9ae51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-290928285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b7c890-6525-4c2f-8c4e-4b85a75d52df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda2c9b4608447af86208785d95abce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=09c12261-41ca-44a5-9683-dfcc15d678d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:02:59Z,use_quota=True,user_id='c44d87d57d614ae4bc45de35a9b44f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287aaa41-da44-4e6f-8262-e6f952ad6c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287aaa41-da44-4e6f-8262-e6f952ad6c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacb370d-81b2-42dd-8d97-fef6f2032c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacb370d-81b2-42dd-8d97-fef6f2032c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72b7c890-6525-4c2f-8c4e-4b85a75d52df', 'volume_name': 'volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df', 'volume_size': 1, 'snapshot_id': '09c12261-41ca-44a5-9683-dfcc15d678d5'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9c6c6a-bdc8-450f-ba54-0fb476d28e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a9c6c6a-bdc8-450f-ba54-0fb476d28e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468f7168-9a15-46dc-b1f5-c316cf079972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:02:59 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Volume 72b7c890-6525-4c2f-8c4e-4b85a75d52df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df', 'volume_size': 1, 'snapshot_id': '09c12261-41ca-44a5-9683-dfcc15d678d5'} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8c22e120-7b13-4de5-aa8d-321bcdfaf46a tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-50da8c42-57b2-4a68-b6c5-6417375683be-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-db0eff62-11f6-4f42-83cb-bab8d8706eaa-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-db0eff62-11f6-4f42-83cb-bab8d8706eaa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=142,cinder:INSERT=52,cinder:UPDATE=194,cinder:DELETE=14 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:UPDATE=198,cinder:DELETE=20,cinder:SELECT=136,cinder:INSERT=41 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-quobyte-db0eff62-11f6-4f42-83cb-bab8d8706eaa" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-db0eff62-11f6-4f42-83cb-bab8d8706eaa" acquired by "delete_volume" :: waited 0.027s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef36eb7-dac0-4660-b78a-acd40003c1fa]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:59 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa Apr 24 20:02:59 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:02:59 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec" returned: 0 in 0.644s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:02:59 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec is being set with open permissions: ugo+rw Apr 24 20:02:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:02:59 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec Apr 24 20:02:59 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:00 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa" returned: 0 in 0.550s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:00 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa Apr 24 20:03:00 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:00 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec" returned: 0 in 0.516s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:00 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.info Apr 24 20:03:00 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:00 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-db0eff62-11f6-4f42-83cb-bab8d8706eaa" returned: 0 in 0.504s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-db0eff62-11f6-4f42-83cb-bab8d8706eaa" released by "delete_volume" :: held 1.108s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:00 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Created reservations ['0058180c-39b4-4c9b-8328-e23cbe653b31', 'a69173cb-5960-45ad-87be-4983593f915d', 'b56e4b21-fc66-45e0-b729-964f29c57b29', '463c4bef-1c84-4711-a9e8-4a9dfb3b9b31'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:01 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:01 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:01 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.info" returned: 0 in 0.608s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:01 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.info is being set with open permissions: ugo+rw Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:01 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.info Apr 24 20:03:01 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:01 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.514s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Deleted volume successfully. Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-47e28cf8-41b2-4f6d-9615-24af020e85d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-db0eff62-11f6-4f42-83cb-bab8d8706eaa-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:01 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.info" returned: 0 in 0.535s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.805s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.084s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-09c12261-41ca-44a5-9683-dfcc15d678d5-72b7c890-6525-4c2f-8c4e-4b85a75d52df" by "_create_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-09c12261-41ca-44a5-9683-dfcc15d678d5-72b7c890-6525-4c2f-8c4e-4b85a75d52df" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Creating volume 72b7c890-6525-4c2f-8c4e-4b85a75d52df from snapshot 09c12261-41ca-44a5-9683-dfcc15d678d5 {{(pid=81641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-72b7c890-6525-4c2f-8c4e-4b85a75d52df" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-dd5fa8bc-e3e4-4dd2-944f-385208988800 tempest-CreateVolumesFromSnapshotTest-43736758 None] Create snapshot completed successfully Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-72b7c890-6525-4c2f-8c4e-4b85a75d52df" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] snapshot: 09c12261-41ca-44a5-9683-dfcc15d678d5, volume: 72b7c890-6525-4c2f-8c4e-4b85a75d52df, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a498d1c-9d04-4dc9-b7f6-676760b583dd]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:01 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 Apr 24 20:03:01 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-quobyte-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1d12af-6937-4fd5-87d8-5a57eb54ea13]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:02 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab Apr 24 20:03:02 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:02 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5" returned: 0 in 0.739s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c97068-931f-404a-90f8-88222b4ffd81]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:02 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 Apr 24 20:03:02 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (170218fb-6b51-429b-b631-06a3b1d8cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150fd526-1562-423f-95dc-33c5deb9cc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150fd526-1562-423f-95dc-33c5deb9cc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1340674908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9280975-a6c6-45f1-9594-d61a9acb1665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:03Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a085f67-477d-413b-b326-1304d5976ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a085f67-477d-413b-b326-1304d5976ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707af591-f151-4a11-b2e4-5e8b0751f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707af591-f151-4a11-b2e4-5e8b0751f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9280975-a6c6-45f1-9594-d61a9acb1665', 'volume_name': 'volume-d9280975-a6c6-45f1-9594-d61a9acb1665', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392312d7-7a27-4921-81f9-548398d324f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392312d7-7a27-4921-81f9-548398d324f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a433b012-99e2-4186-8f2f-da526f723f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:02 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume d9280975-a6c6-45f1-9594-d61a9acb1665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9280975-a6c6-45f1-9594-d61a9acb1665', 'volume_size': 1} Apr 24 20:03:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:03 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab" returned: 0 in 1.200s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:03 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab Apr 24 20:03:03 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (9e6d73fb-c450-4156-9093-aa9da8900a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf33068-2b1f-4f81-8a39-1fcdf90e6d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf33068-2b1f-4f81-8a39-1fcdf90e6d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-598163233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609595cd-99fd-48a9-8057-d36e868825c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:03Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92387b00-ade9-4483-b50e-8f3970a09dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92387b00-ade9-4483-b50e-8f3970a09dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54fba2c-595d-4b4a-8a6e-7796e6b80b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54fba2c-595d-4b4a-8a6e-7796e6b80b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609595cd-99fd-48a9-8057-d36e868825c7', 'volume_name': 'volume-609595cd-99fd-48a9-8057-d36e868825c7', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a2f251-3edb-475f-b93a-bf70e845b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a2f251-3edb-475f-b93a-bf70e845b60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0de8d10-c3ed-47df-a810-35e07c24e2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume 609595cd-99fd-48a9-8057-d36e868825c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609595cd-99fd-48a9-8057-d36e868825c7', 'volume_size': 1} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:03 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (13bb8ea4-73ed-4e1e-bc31-5ef0e7e1f599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d43112e-12d4-446e-bcec-2d119bde03fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d43112e-12d4-446e-bcec-2d119bde03fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556735156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3122f5e-320f-4442-9de3-6f7336b1c5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:04Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b46e79-972a-4345-83b8-88e66efd9a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b46e79-972a-4345-83b8-88e66efd9a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1784e51-caf6-4f4c-b930-dea7bf174d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1784e51-caf6-4f4c-b930-dea7bf174d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3122f5e-320f-4442-9de3-6f7336b1c5b6', 'volume_name': 'volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46ebbd8-ff96-44ac-b170-5abdb0fd4bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46ebbd8-ff96-44ac-b170-5abdb0fd4bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ea9723-ab5d-4ae2-9011-be62e9d777ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:03 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume d3122f5e-320f-4442-9de3-6f7336b1c5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6', 'volume_size': 1} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" returned: 0 in 1.246s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:03 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df Apr 24 20:03:03 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:03 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab" returned: 0 in 0.767s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:03 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab" released by "delete_volume" :: held 2.005s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Created reservations ['95f91cf7-6a3d-4c9a-b9e2-c7b2ed3f2745', 'fcec18d4-55c5-4076-994e-25246d30dd67', '8a705e13-df46-4387-90e8-cb81f234de92', '43cfd527-1e93-411b-8fc7-e66cb0e31a8f'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:04 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:04 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (2e24cd8e-05d8-4d25-9fae-b622eae5210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3bdc3b-d745-4e70-bc86-1734da76fd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3bdc3b-d745-4e70-bc86-1734da76fd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1711580416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:04Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f3fbf-5347-459e-b987-695c96074294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f3fbf-5347-459e-b987-695c96074294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cff17fe-04ce-44a8-8117-ca8483395bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cff17fe-04ce-44a8-8117-ca8483395bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5', 'volume_name': 'volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfb115f-4a75-495f-9c69-d76a1e159d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfb115f-4a75-495f-9c69-d76a1e159d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994b0d32-ea6e-4558-9e7b-0fa7cc10aa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume 7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5', 'volume_size': 1} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-ea84921d-0dab-4d5f-af85-4fcb3bcf7110-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-ea84921d-0dab-4d5f-af85-4fcb3bcf7110-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "cinder-quobyte-ea84921d-0dab-4d5f-af85-4fcb3bcf7110" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-ea84921d-0dab-4d5f-af85-4fcb3bcf7110" acquired by "delete_volume" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c848af44-1bca-4028-833b-127f59b109d3]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:04 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 Apr 24 20:03:04 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (abfd638f-143e-4017-ac05-c6c04f371aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d3ced2-a3f3-43b0-b99b-60b1d1f47593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d3ced2-a3f3-43b0-b99b-60b1d1f47593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1388138537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5e0cde-cbb5-4702-8835-d025698fbf61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:05Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e667ac8-b5cc-496e-b5ef-a26e5e680893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e667ac8-b5cc-496e-b5ef-a26e5e680893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934d48ad-048f-4b9e-beb6-e489f78222cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934d48ad-048f-4b9e-beb6-e489f78222cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5e0cde-cbb5-4702-8835-d025698fbf61', 'volume_name': 'volume-2b5e0cde-cbb5-4702-8835-d025698fbf61', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f39eeaa-1c7c-42e6-8a76-9e753eb58b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f39eeaa-1c7c-42e6-8a76-9e753eb58b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3edafb5-9348-4843-a946-c05031914d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:04 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume 2b5e0cde-cbb5-4702-8835-d025698fbf61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5e0cde-cbb5-4702-8835-d025698fbf61', 'volume_size': 1} Apr 24 20:03:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:05 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.469s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:05 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:05 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Deleted volume successfully. Apr 24 20:03:05 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110" returned: 0 in 1.273s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d2cb5184-1004-424d-a942-b9c3906e18d8 tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-0e3e0b7e-ff0e-40f2-a5fc-3a80dd5db2ab-delete_volume" released by "delete_volume" :: held 3.871s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:05 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110 Apr 24 20:03:05 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:07 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-ea84921d-0dab-4d5f-af85-4fcb3bcf7110" returned: 0 in 1.332s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-quobyte-ea84921d-0dab-4d5f-af85-4fcb3bcf7110" released by "delete_volume" :: held 2.668s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:07 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Created reservations ['8ecf1c1e-8ed5-461d-be3e-1c45ce6a6732', 'e5b932e4-848f-49a0-ad45-0ccf78eaefed', '984cba2e-9557-4daa-9d1e-81d3ec57415b', '65789d5f-29dc-4a93-9c10-3f47e0393683'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:07 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:07 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:07 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:09 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.820s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:09 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:09 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Deleted volume successfully. Apr 24 20:03:09 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f64746ee-427b-4274-8303-101e30b1a3ff tempest-CreateVolumesFromImageTest-652110745 None] Lock "cinder-ea84921d-0dab-4d5f-af85-4fcb3bcf7110-delete_volume" released by "delete_volume" :: held 4.958s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Flow 'volume_create_manager' (4825b7d6-9b6f-43d7-9fbc-d6c580129059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4c28d7-0554-4548-a551-c0b0d5ae65f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4c28d7-0554-4548-a551-c0b0d5ae65f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-981138222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790d17c4-c6b6-4d71-89f1-49d2352d4097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc5c2a25d04cfbbe5e7b9b3060e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:10Z,use_quota=True,user_id='892ce048f2d14996851a3fa797ea5478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2e569d-98bc-4034-9bb3-e4f210a8b450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2e569d-98bc-4034-9bb3-e4f210a8b450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac418a50-d237-4ecc-828e-390c9c90b362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac418a50-d237-4ecc-828e-390c9c90b362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790d17c4-c6b6-4d71-89f1-49d2352d4097', 'volume_name': 'volume-790d17c4-c6b6-4d71-89f1-49d2352d4097', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a452f0-3da6-489f-af13-47c251ec3cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a452f0-3da6-489f-af13-47c251ec3cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2882457-b48a-4969-acff-5086e926ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:10 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Volume 790d17c4-c6b6-4d71-89f1-49d2352d4097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790d17c4-c6b6-4d71-89f1-49d2352d4097', 'volume_size': 1} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:10 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df" returned: 0 in 6.570s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[20346143-78b3-405c-93ac-d9b6f2d729d1]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:10 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:10 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 Apr 24 20:03:10 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:11 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" returned: 0 in 0.676s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:03:11 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Converted 1024.00 MB image at 155.83 MB/s Apr 24 20:03:11 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df is being set with open permissions: ugo+rw Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:11 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df Apr 24 20:03:11 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:11 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df" returned: 0 in 0.490s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-72b7c890-6525-4c2f-8c4e-4b85a75d52df" released by "_copy_volume_from_snapshot" :: held 9.821s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-09c12261-41ca-44a5-9683-dfcc15d678d5-72b7c890-6525-4c2f-8c4e-4b85a75d52df" released by "_create_volume_from_snapshot" :: held 9.857s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.892s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.668s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1340674908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9280975-a6c6-45f1-9594-d61a9acb1665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:03Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Creating volume d9280975-a6c6-45f1-9594-d61a9acb1665 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:11 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:11 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665 1073741824 Apr 24 20:03:11 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468f7168-9a15-46dc-b1f5-c316cf079972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df', 'volume_size': 1, 'snapshot_id': '09c12261-41ca-44a5-9683-dfcc15d678d5'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb70829d-1d78-4011-8646-56f5b0e54d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:11 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Volume volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df (72b7c890-6525-4c2f-8c4e-4b85a75d52df): created successfully Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb70829d-1d78-4011-8646-56f5b0e54d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Flow 'volume_create_manager' (b0a449ca-5584-4a56-b8e5-473a1d1f6661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:11 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-3ad0be70-d534-4f02-ba92-fcf6e6c399f9 tempest-VolumeDependencyTests-1633329746 None] Created volume successfully. Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (e98bcec3-2a74-45b4-8153-2749e8d56aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601fa90b-e8f2-4999-845e-986c920d17b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601fa90b-e8f2-4999-845e-986c920d17b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43016292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:12Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:11 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f22f967-bb7b-4255-8710-fc16ab4e8d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f22f967-bb7b-4255-8710-fc16ab4e8d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086e85be-8daf-4adb-a98c-06bf7cb82f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086e85be-8daf-4adb-a98c-06bf7cb82f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83', 'volume_name': 'volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5085435d-ecc5-4603-a208-5897b0b766ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5085435d-ecc5-4603-a208-5897b0b766ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c41679e-0d99-4764-adc5-ec24e27cad4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:12 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume 3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83', 'volume_size': 1} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:12 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665 1073741824" returned: 0 in 0.625s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:12 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665 Apr 24 20:03:12 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-09c12261-41ca-44a5-9683-dfcc15d678d5-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-09c12261-41ca-44a5-9683-dfcc15d678d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-09c12261-41ca-44a5-9683-dfcc15d678d5" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-09c12261-41ca-44a5-9683-dfcc15d678d5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Deleting offline snapshot 09c12261-41ca-44a5-9683-dfcc15d678d5 of volume e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] snapshot_file for this snap is: volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3537f51-fb2e-4d60-8789-e0500c6cda3d]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:12 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665" returned: 0 in 0.449s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.245s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-598163233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609595cd-99fd-48a9-8057-d36e868825c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:03Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Creating volume 609595cd-99fd-48a9-8057-d36e868825c7 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:12 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:12 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 Apr 24 20:03:12 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a433b012-99e2-4186-8f2f-da526f723f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9280975-a6c6-45f1-9594-d61a9acb1665', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:12 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7 1073741824 Apr 24 20:03:12 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a519626-c3aa-4939-9741-e402596a3512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:12 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume volume-d9280975-a6c6-45f1-9594-d61a9acb1665 (d9280975-a6c6-45f1-9594-d61a9acb1665): created successfully Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a519626-c3aa-4939-9741-e402596a3512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:12 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (170218fb-6b51-429b-b631-06a3b1d8cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:12 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-91f0b260-9f41-4532-8477-df6c6b4439ce tempest-CreateVolumesFromSnapshotTest-43736758 None] Created volume successfully. Apr 24 20:03:13 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5" returned: 0 in 0.666s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8195a1e-1f69-4dd6-9aa5-19073a13393d]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:13 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7 1073741824" returned: 0 in 0.667s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:13 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 Apr 24 20:03:13 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:13 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7 Apr 24 20:03:13 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:13 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" returned: 0 in 0.543s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:13 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7" returned: 0 in 0.469s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:13 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 Apr 24 20:03:13 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.109s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556735156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3122f5e-320f-4442-9de3-6f7336b1c5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:04Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Creating volume d3122f5e-320f-4442-9de3-6f7336b1c5b6 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:13 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0de8d10-c3ed-47df-a810-35e07c24e2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609595cd-99fd-48a9-8057-d36e868825c7', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6946342a-6629-42b3-ad14-6fc2f76a0ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:13 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 1073741824 Apr 24 20:03:13 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:13 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume volume-609595cd-99fd-48a9-8057-d36e868825c7 (609595cd-99fd-48a9-8057-d36e868825c7): created successfully Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6946342a-6629-42b3-ad14-6fc2f76a0ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:13 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (9e6d73fb-c450-4156-9093-aa9da8900a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:13 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e9e357f6-c629-4afd-9362-df8c0fba798b tempest-CreateVolumesFromSnapshotTest-43736758 None] Created volume successfully. Apr 24 20:03:14 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5" returned: 0 in 0.589s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:14 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5 Apr 24 20:03:14 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:14 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 1073741824" returned: 0 in 0.684s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:14 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 Apr 24 20:03:14 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:14 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:14 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927.09c12261-41ca-44a5-9683-dfcc15d678d5" returned: 0 in 0.450s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-09c12261-41ca-44a5-9683-dfcc15d678d5" released by "_delete_snapshot" :: held 2.351s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:14 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" released by "delete_snapshot" :: held 2.383s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Created reservations ['40669350-59b3-46f2-a24f-1c6bc84ec0a5', 'a6eb8583-c488-4a20-a77f-c1ba750963e4', 'd56f539b-0ed7-4ea5-9066-435cb7af3794', '00572cd7-9036-4251-8f63-fd8a21b90931'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:15 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Delete snapshot completed successfully. Apr 24 20:03:15 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6" returned: 0 in 0.462s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-21cdca58-5b9f-41ea-9d41-7510f73e5125 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-09c12261-41ca-44a5-9683-dfcc15d678d5-delete_snapshot" released by "delete_snapshot" :: held 2.540s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.793s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1711580416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:04Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Creating volume 7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:15 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ea9723-ab5d-4ae2-9011-be62e9d777ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:15 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 1073741824 Apr 24 20:03:15 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb4a9fe-e438-4d55-8b18-73b67c583c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:15 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 (d3122f5e-320f-4442-9de3-6f7336b1c5b6): created successfully Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb4a9fe-e438-4d55-8b18-73b67c583c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (13bb8ea4-73ed-4e1e-bc31-5ef0e7e1f599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:15 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e29fad71-4d72-4b07-815b-c7b8c94c2b18 tempest-CreateVolumesFromSnapshotTest-43736758 None] Created volume successfully. Apr 24 20:03:15 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 1073741824" returned: 0 in 0.617s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:15 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 Apr 24 20:03:15 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[36562916-df08-4f98-8785-cccb4ed60843]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:15 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:15 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 Apr 24 20:03:15 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:16 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5" returned: 0 in 0.508s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.581s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1388138537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5e0cde-cbb5-4702-8835-d025698fbf61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223751b5342e4550ac645b713fd749d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:05Z,use_quota=True,user_id='decb1d57b1aa424cbe5ec1cce7b26d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Creating volume 2b5e0cde-cbb5-4702-8835-d025698fbf61 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:16 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994b0d32-ea6e-4558-9e7b-0fa7cc10aa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:16 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 1073741824 Apr 24 20:03:16 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee83a332-85ba-42f3-b422-be719c85cd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:16 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 (7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5): created successfully Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee83a332-85ba-42f3-b422-be719c85cd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (2e24cd8e-05d8-4d25-9fae-b622eae5210b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:16 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-67def91b-f915-43fa-87a1-7b838cc7fcfa tempest-CreateVolumesFromSnapshotTest-43736758 None] Created volume successfully. Apr 24 20:03:16 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" returned: 0 in 0.557s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:16 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927 Apr 24 20:03:16 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:16 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" returned: 0 in 0.538s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:16 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927" released by "delete_volume" :: held 1.151s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:17 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 1073741824" returned: 0 in 0.720s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Created reservations ['949bc19e-ea49-4d82-b190-24db42cf5df7', 'fe291925-58de-4f63-af17-5f4789716769', 'b57a95f1-ce82-46cc-8b01-0c68a1a912e1', '9d5d3a21-9537-442e-98cd-07cc236ff20d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:17 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 Apr 24 20:03:17 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:17 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:17 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:17 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61" returned: 0 in 0.485s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.214s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-981138222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790d17c4-c6b6-4d71-89f1-49d2352d4097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc5c2a25d04cfbbe5e7b9b3060e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:10Z,use_quota=True,user_id='892ce048f2d14996851a3fa797ea5478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Creating volume 790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:17 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3edafb5-9348-4843-a946-c05031914d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5e0cde-cbb5-4702-8835-d025698fbf61', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:17 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 1073741824 Apr 24 20:03:17 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2014e443-4ca0-4ea9-93b1-26dc912aacc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:17 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.474s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:17 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Volume volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 (2b5e0cde-cbb5-4702-8835-d025698fbf61): created successfully Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2014e443-4ca0-4ea9-93b1-26dc912aacc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Flow 'volume_create_manager' (abfd638f-143e-4017-ac05-c6c04f371aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:17 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Deleted volume successfully. Apr 24 20:03:17 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d6428bc5-4fb8-4d54-b8bf-a58e88bafb71 tempest-CreateVolumesFromSnapshotTest-43736758 None] Created volume successfully. Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-7c517f66-34bc-4c7f-beb0-5d27b4884d50 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-e1e3ad9b-3b1a-4d6e-bc80-ac6ebaab3927-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-2b5e0cde-cbb5-4702-8835-d025698fbf61-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:17 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-2b5e0cde-cbb5-4702-8835-d025698fbf61-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-quobyte-2b5e0cde-cbb5-4702-8835-d025698fbf61" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-2b5e0cde-cbb5-4702-8835-d025698fbf61" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[976454c9-dee2-4b93-930f-12068fbc2ccd]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:18 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 Apr 24 20:03:18 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:18 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 1073741824" returned: 0 in 0.678s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:18 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 Apr 24 20:03:18 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Flow 'volume_create_manager' (f84bee99-2438-4f66-ac3f-dc85d359fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec2d917-9d18-4f91-bcfb-6841fbaf9ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec2d917-9d18-4f91-bcfb-6841fbaf9ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-32182956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f9471f-f306-47bb-87f1-3ea44fde092a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda2c9b4608447af86208785d95abce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:18Z,use_quota=True,user_id='c44d87d57d614ae4bc45de35a9b44f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0238d2e4-e694-48ba-bd3f-5f47cc68aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0238d2e4-e694-48ba-bd3f-5f47cc68aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1391765c-dc68-4928-b55d-6c29a6011194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1391765c-dc68-4928-b55d-6c29a6011194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f9471f-f306-47bb-87f1-3ea44fde092a', 'volume_name': 'volume-e1f9471f-f306-47bb-87f1-3ea44fde092a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8252974d-3e7f-431d-be10-9ef74ee2a485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8252974d-3e7f-431d-be10-9ef74ee2a485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65108bdc-26ee-4f77-a8ca-6ccd8a21b37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:18 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Volume e1f9471f-f306-47bb-87f1-3ea44fde092a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f9471f-f306-47bb-87f1-3ea44fde092a', 'volume_size': 1} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:18 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61" returned: 0 in 0.658s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:18 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61 Apr 24 20:03:18 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:18 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097" returned: 0 in 0.455s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.726s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43016292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:12Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Creating volume 3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:18 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:18 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 1073741824 Apr 24 20:03:18 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2882457-b48a-4969-acff-5086e926ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790d17c4-c6b6-4d71-89f1-49d2352d4097', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b694c2f4-249d-4672-85e6-82b8fe425fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:18 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Volume volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 (790d17c4-c6b6-4d71-89f1-49d2352d4097): created successfully Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b694c2f4-249d-4672-85e6-82b8fe425fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:18 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Flow 'volume_create_manager' (4825b7d6-9b6f-43d7-9fbc-d6c580129059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:18 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e248ca22-a91d-406b-a81d-748a3866402f tempest-SnapshotDependencyTests-129297756 None] Created volume successfully. Apr 24 20:03:19 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-2b5e0cde-cbb5-4702-8835-d025698fbf61" returned: 0 in 0.477s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-2b5e0cde-cbb5-4702-8835-d025698fbf61" released by "delete_volume" :: held 1.176s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Created reservations ['43ed84a4-de7a-44e7-a3dc-a1132e8b3510', 'ba266bf6-e53c-4b1b-b8ef-9561e1f9beb8', 'bd88d013-0df7-4e0a-bf5a-7dcf4ab8e883', 'f1cc143e-1424-4656-bd6b-666e11c2ef42'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:19 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:19 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:19 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 1073741824" returned: 0 in 0.641s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:19 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 Apr 24 20:03:19 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:19 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.516s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:19 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Deleted volume successfully. Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ada234ab-8bf4-4842-a240-770c709b6cfc tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-2b5e0cde-cbb5-4702-8835-d025698fbf61-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:19 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83" returned: 0 in 0.500s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.518s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-32182956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f9471f-f306-47bb-87f1-3ea44fde092a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda2c9b4608447af86208785d95abce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:18Z,use_quota=True,user_id='c44d87d57d614ae4bc45de35a9b44f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Creating volume e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:19 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c41679e-0d99-4764-adc5-ec24e27cad4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cf3bff-e176-46a6-8207-d5841e6acbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:19 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a 1073741824 Apr 24 20:03:19 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:19 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 (3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83): created successfully Apr 24 20:03:19 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cf3bff-e176-46a6-8207-d5841e6acbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (e98bcec3-2a74-45b4-8153-2749e8d56aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:20 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5712561c-65fc-4bce-bac1-29d4cf37f323 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created volume successfully. Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-quobyte-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[54778059-d372-41e2-aac8-a71e19228be8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:20 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 Apr 24 20:03:20 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:20 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a 1073741824" returned: 0 in 0.677s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:20 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a Apr 24 20:03:20 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (aae80b4f-fe99-416b-99ae-586afd97ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2afee4b-6977-4e7f-94b0-cd0268508cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2afee4b-6977-4e7f-94b0-cd0268508cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444782941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1688ae03-fd4e-46f6-860c-aec2d3bfd864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:21Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:20 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592d6e81-1450-457b-80a7-d3cad379c622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592d6e81-1450-457b-80a7-d3cad379c622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6262ff54-2d47-47d0-b384-8e2a6bdff5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6262ff54-2d47-47d0-b384-8e2a6bdff5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1688ae03-fd4e-46f6-860c-aec2d3bfd864', 'volume_name': 'volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e846fa4-3375-401e-981f-d0fa789fb46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e846fa4-3375-401e-981f-d0fa789fb46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99349583-ca22-4f99-82c9-5bbdd38e8b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:20 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume 1688ae03-fd4e-46f6-860c-aec2d3bfd864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864', 'volume_size': 1} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5" returned: 0 in 0.680s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:20 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:20 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5 Apr 24 20:03:20 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (aef1de80-f685-4181-bcdc-631c03690c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9383fbd7-8cf1-4158-8461-83f5352909fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9383fbd7-8cf1-4158-8461-83f5352909fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934471135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cee2b3d-805b-466f-aaf6-b324a091739a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:21Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7664b6c7-627c-4bfa-89aa-659043ba23e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7664b6c7-627c-4bfa-89aa-659043ba23e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d9bf22-65c1-4c81-b8b4-150be3a2aed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d9bf22-65c1-4c81-b8b4-150be3a2aed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cee2b3d-805b-466f-aaf6-b324a091739a', 'volume_name': 'volume-9cee2b3d-805b-466f-aaf6-b324a091739a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c06b3d-1669-4861-9327-254034378051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c06b3d-1669-4861-9327-254034378051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38eebb28-9e27-4ad3-ad51-c10e3e355c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume 9cee2b3d-805b-466f-aaf6-b324a091739a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cee2b3d-805b-466f-aaf6-b324a091739a', 'volume_size': 1} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:21 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a" returned: 0 in 0.601s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.629s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65108bdc-26ee-4f77-a8ca-6ccd8a21b37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f9471f-f306-47bb-87f1-3ea44fde092a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081a113e-34b9-4cfb-ac63-82c4108d9a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Creating offline snapshot 0d2043a0-447b-486d-9644-b56a2943c990 of volume 790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:03:21 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Volume volume-e1f9471f-f306-47bb-87f1-3ea44fde092a (e1f9471f-f306-47bb-87f1-3ea44fde092a): created successfully Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081a113e-34b9-4cfb-ac63-82c4108d9a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Flow 'volume_create_manager' (f84bee99-2438-4f66-ac3f-dc85d359fc09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b08d3b-40d2-4157-b76e-052aaf1ff412]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:21 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8d675720-d2de-4c4d-884a-4033b4a53a6b tempest-VolumeDependencyTests-1633329746 None] Created volume successfully. Apr 24 20:03:21 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 Apr 24 20:03:21 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:21 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (0cd46d6e-afa7-4fa4-9c4c-b12f6c2bb755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e3af6f-186d-49e8-b45d-32c593cfe1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5" returned: 0 in 0.596s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e3af6f-186d-49e8-b45d-32c593cfe1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947707217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe36015-a99e-43d8-ad44-35fe7f47201c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:21Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f06c490-9a35-449d-a736-521897886b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f06c490-9a35-449d-a736-521897886b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b1ad49-06dc-42cc-9c00-bfbd3ce26eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b1ad49-06dc-42cc-9c00-bfbd3ce26eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe36015-a99e-43d8-ad44-35fe7f47201c', 'volume_name': 'volume-6fe36015-a99e-43d8-ad44-35fe7f47201c', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd457c3-604a-494f-988c-93d0f607686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd457c3-604a-494f-988c-93d0f607686a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c3a61d-5e5b-4f9c-bb22-3de990bf6f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:21 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume 6fe36015-a99e-43d8-ad44-35fe7f47201c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe36015-a99e-43d8-ad44-35fe7f47201c', 'volume_size': 1} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5" released by "delete_volume" :: held 1.351s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Created reservations ['6ff595b5-16af-4487-91e6-2e6e839f7971', '03044ef1-9aac-4526-82db-ef2559d8b2df', '406333af-a027-437e-8552-3dddc43df9c4', 'b5acae1b-a5aa-4190-88be-869186bc1c99'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:21 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:21 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:21 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (19799adc-f1ce-4931-8d52-4ae01d15e340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c2dc2f-9139-4a44-ac16-020b5302d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c2dc2f-9139-4a44-ac16-020b5302d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259447067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85d55e2-46fa-4530-97ff-4ca21f4c33c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:22Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f783a22a-6268-4525-9b4c-d2dce70d4678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f783a22a-6268-4525-9b4c-d2dce70d4678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52cf96be-4403-400f-9ef6-047b26d2fc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52cf96be-4403-400f-9ef6-047b26d2fc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85d55e2-46fa-4530-97ff-4ca21f4c33c4', 'volume_name': 'volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931fcf7a-8d62-4d1f-a8d4-016c03a82532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931fcf7a-8d62-4d1f-a8d4-016c03a82532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08eb7ed7-ee34-4373-8e37-af2ce19eaf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume a85d55e2-46fa-4530-97ff-4ca21f4c33c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4', 'volume_size': 1} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:22 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097" returned: 0 in 0.891s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:22 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 1G Apr 24 20:03:22 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (e3c353a6-be31-4fa7-938c-7f3acb11eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734b03cc-6926-4242-b4da-bf4347dd60aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Flow 'volume_create_manager' (273e7e97-648a-4b30-9e03-4f3614d369d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4fd6de-b1a5-455a-8bc8-358df6f13492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734b03cc-6926-4242-b4da-bf4347dd60aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2130720649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838fbcd4-b65e-46b4-9deb-65491e4db1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:22Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbad5b50-0181-4929-9c02-d17c90832d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbad5b50-0181-4929-9c02-d17c90832d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a7761e-d085-4a49-a6a8-8bc6911e373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a7761e-d085-4a49-a6a8-8bc6911e373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '838fbcd4-b65e-46b4-9deb-65491e4db1c3', 'volume_name': 'volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ef9590-6c94-4701-9857-9ef13fbf0237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ef9590-6c94-4701-9857-9ef13fbf0237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57ccb89-43d0-42b5-b9cb-909076712b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume 838fbcd4-b65e-46b4-9deb-65491e4db1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3', 'volume_size': 1} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.679s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:22 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Deleted volume successfully. Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4fd6de-b1a5-455a-8bc8-358df6f13492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-574802737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda2c9b4608447af86208785d95abce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e1f9471f-f306-47bb-87f1-3ea44fde092a,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:22Z,use_quota=True,user_id='c44d87d57d614ae4bc45de35a9b44f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed2e85b-c4aa-4982-a272-712d414fec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed2e85b-c4aa-4982-a272-712d414fec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ca8d2c-813f-4ea8-b3f9-1012ce65a52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-d3122f5e-320f-4442-9de3-6f7336b1c5b6-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ca8d2c-813f-4ea8-b3f9-1012ce65a52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9', 'volume_name': 'volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9', 'volume_size': 1, 'source_volid': 'e1f9471f-f306-47bb-87f1-3ea44fde092a', 'source_volstatus': 'available'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656c1b42-d65d-4d6f-a499-17fcf40f25c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656c1b42-d65d-4d6f-a499-17fcf40f25c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad6b09a-5414-4ad0-85ed-8e6a8aa6c156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:22 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Volume 4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9', 'volume_size': 1, 'source_volid': 'e1f9471f-f306-47bb-87f1-3ea44fde092a', 'source_volstatus': 'available'} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-eda8f585-f08a-4a4f-8060-0c12d293e890 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-7e5ac66b-df38-4e4f-801c-ce44a8ebd6d5-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-d3122f5e-320f-4442-9de3-6f7336b1c5b6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-quobyte-d3122f5e-320f-4442-9de3-6f7336b1c5b6" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-d3122f5e-320f-4442-9de3-6f7336b1c5b6" acquired by "delete_volume" :: waited 0.012s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a269bb-4923-44af-87dd-7983bb5223c5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:22 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 Apr 24 20:03:22 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:22 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 1G" returned: 0 in 0.702s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:22 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:23 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 Apr 24 20:03:23 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:23 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6" returned: 0 in 0.568s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:23 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6 Apr 24 20:03:23 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:23 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990" returned: 0 in 0.511s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:23 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 is being set with open permissions: ugo+rw Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:23 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 Apr 24 20:03:23 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:23 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d3122f5e-320f-4442-9de3-6f7336b1c5b6" returned: 0 in 0.462s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-d3122f5e-320f-4442-9de3-6f7336b1c5b6" released by "delete_volume" :: held 1.065s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Created reservations ['fa846c62-349b-4ed0-ad56-1528d40cc16b', '09add5ef-e475-4930-bbc4-9590ba877e27', '71e3411b-4336-4abb-91ec-9127a764906c', '87448829-e803-4a7f-b50b-10734cd9d368'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:23 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:23 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:23 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:23 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990" returned: 0 in 0.488s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:24 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.info Apr 24 20:03:24 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:24 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.451s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:24 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Deleted volume successfully. Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-04319b95-77c7-4f28-a302-4c20de3c43ac tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-d3122f5e-320f-4442-9de3-6f7336b1c5b6-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:24 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.info" returned: 0 in 0.472s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:24 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.info is being set with open permissions: ugo+rw Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:24 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.info Apr 24 20:03:24 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-609595cd-99fd-48a9-8057-d36e868825c7-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-609595cd-99fd-48a9-8057-d36e868825c7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-quobyte-609595cd-99fd-48a9-8057-d36e868825c7" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-609595cd-99fd-48a9-8057-d36e868825c7" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce99a5a-c880-4748-9609-8df7406254a5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:24 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7 Apr 24 20:03:24 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:24 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.info" returned: 0 in 0.465s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.674s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.026s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444782941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1688ae03-fd4e-46f6-860c-aec2d3bfd864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:21Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Creating volume 1688ae03-fd4e-46f6-860c-aec2d3bfd864 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:24 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:24 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:25 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 1073741824 Apr 24 20:03:25 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:25 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-5fb91452-fdec-4e62-93b7-c83bbeb615b5 tempest-SnapshotDependencyTests-129297756 None] Create snapshot completed successfully Apr 24 20:03:25 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7" returned: 0 in 0.531s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:25 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7 Apr 24 20:03:25 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:25 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 1073741824" returned: 0 in 0.626s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:25 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 Apr 24 20:03:25 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:25 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-609595cd-99fd-48a9-8057-d36e868825c7" returned: 0 in 0.512s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-609595cd-99fd-48a9-8057-d36e868825c7" released by "delete_volume" :: held 1.083s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Created reservations ['531472be-0b8b-40c0-93a5-df7ee4aae693', 'd292677c-9a6b-4a33-b723-59d6aa324b7b', 'ff0c8960-35b4-48a1-944b-9009bce820e4', '99be2968-b387-44d8-bf81-301854c661bd'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:25 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:25 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:25 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:26 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864" returned: 0 in 0.462s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.870s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934471135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cee2b3d-805b-466f-aaf6-b324a091739a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:21Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Creating volume 9cee2b3d-805b-466f-aaf6-b324a091739a {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:26 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99349583-ca22-4f99-82c9-5bbdd38e8b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87021b5-b204-4bcf-829a-78c3cd02ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:26 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a 1073741824 Apr 24 20:03:26 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:26 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 (1688ae03-fd4e-46f6-860c-aec2d3bfd864): created successfully Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87021b5-b204-4bcf-829a-78c3cd02ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (aae80b4f-fe99-416b-99ae-586afd97ae47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:26 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-4b24bc24-34fb-407b-ac11-ee91b83dbc7b tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created volume successfully. Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Flow 'volume_create_manager' (b1a0809e-4130-4797-9999-07694c61f95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10f5210-24cb-4cf6-965d-35a2c194dcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:26 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10f5210-24cb-4cf6-965d-35a2c194dcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a0342d-1e63-463b-ad7f-5be454b8a7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc5c2a25d04cfbbe5e7b9b3060e433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d2043a0-447b-486d-9644-b56a2943c990,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:26Z,use_quota=True,user_id='892ce048f2d14996851a3fa797ea5478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a9ac12-971a-44d2-afd2-b257fc852c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a9ac12-971a-44d2-afd2-b257fc852c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5434969f-88db-4f0b-a800-bc39e8b9d070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5434969f-88db-4f0b-a800-bc39e8b9d070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '07a0342d-1e63-463b-ad7f-5be454b8a7d2', 'volume_name': 'volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2', 'volume_size': 1, 'snapshot_id': '0d2043a0-447b-486d-9644-b56a2943c990'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f268be-f357-47eb-9533-63e46bf4f656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f268be-f357-47eb-9533-63e46bf4f656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982c8808-6f24-4b2d-bdd7-fcde5b2a1440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:26 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Volume 07a0342d-1e63-463b-ad7f-5be454b8a7d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2', 'volume_size': 1, 'snapshot_id': '0d2043a0-447b-486d-9644-b56a2943c990'} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.614s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:26 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Deleted volume successfully. Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-0d91f48d-d15e-4bfe-828b-7bddfa747811 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-609595cd-99fd-48a9-8057-d36e868825c7-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:26 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a 1073741824" returned: 0 in 0.689s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:26 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a Apr 24 20:03:26 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-d9280975-a6c6-45f1-9594-d61a9acb1665-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-d9280975-a6c6-45f1-9594-d61a9acb1665-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-quobyte-d9280975-a6c6-45f1-9594-d61a9acb1665" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-d9280975-a6c6-45f1-9594-d61a9acb1665" acquired by "delete_volume" :: waited 0.013s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f96506-45f1-40fc-af02-5a0ff67f4830]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:26 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:27 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665 Apr 24 20:03:27 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:27 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a" returned: 0 in 0.482s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.735s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947707217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe36015-a99e-43d8-ad44-35fe7f47201c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:21Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Creating volume 6fe36015-a99e-43d8-ad44-35fe7f47201c {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:27 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38eebb28-9e27-4ad3-ad51-c10e3e355c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cee2b3d-805b-466f-aaf6-b324a091739a', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c51f56f-c5f9-474d-9f23-214c7851d139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:27 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c 1073741824 Apr 24 20:03:27 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:27 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume volume-9cee2b3d-805b-466f-aaf6-b324a091739a (9cee2b3d-805b-466f-aaf6-b324a091739a): created successfully Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c51f56f-c5f9-474d-9f23-214c7851d139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (aef1de80-f685-4181-bcdc-631c03690c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:27 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-94d5c8e7-b969-4fd5-b2b1-e3d53aa5a4c9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created volume successfully. Apr 24 20:03:27 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665" returned: 0 in 0.564s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:27 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665 Apr 24 20:03:27 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:27 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:27 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c 1073741824" returned: 0 in 0.648s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:28 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c Apr 24 20:03:28 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:28 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-d9280975-a6c6-45f1-9594-d61a9acb1665" returned: 0 in 0.545s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-d9280975-a6c6-45f1-9594-d61a9acb1665" released by "delete_volume" :: held 1.146s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Created reservations ['2adf8f24-40f9-40b6-b402-a949837d8177', '158b508c-edde-49c7-bf5e-47e0851fc710', 'b2afcef7-7591-4761-be98-9776531a08a3', '52c8d465-718c-4a22-8c06-f30479703812'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:28 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:28 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:28 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c" returned: 0 in 0.456s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.311s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259447067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85d55e2-46fa-4530-97ff-4ca21f4c33c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:22Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Creating volume a85d55e2-46fa-4530-97ff-4ca21f4c33c4 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:28 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c3a61d-5e5b-4f9c-bb22-3de990bf6f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe36015-a99e-43d8-ad44-35fe7f47201c', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a376b88-4473-4dd3-8097-1ca5e905cb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:28 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume volume-6fe36015-a99e-43d8-ad44-35fe7f47201c (6fe36015-a99e-43d8-ad44-35fe7f47201c): created successfully Apr 24 20:03:28 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 1073741824 Apr 24 20:03:28 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a376b88-4473-4dd3-8097-1ca5e905cb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (0cd46d6e-afa7-4fa4-9c4c-b12f6c2bb755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:28 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-19987b09-2911-4c0f-90c4-5aa27c9acb01 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created volume successfully. Apr 24 20:03:28 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.458s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:28 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Deleted volume successfully. Apr 24 20:03:28 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-ee5b7261-ac0a-4f45-90a6-505138f5f2b7 tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-d9280975-a6c6-45f1-9594-d61a9acb1665-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-5e93c66a-c4e5-4fee-a9b7-b41547f64fec-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-5e93c66a-c4e5-4fee-a9b7-b41547f64fec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-quobyte-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-quobyte-5e93c66a-c4e5-4fee-a9b7-b41547f64fec" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-5e93c66a-c4e5-4fee-a9b7-b41547f64fec" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Deleting offline snapshot 5e93c66a-c4e5-4fee-a9b7-b41547f64fec of volume 8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] snapshot_file for this snap is: volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:03:29 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 1073741824" returned: 0 in 0.690s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e6da93-726b-4a76-80f2-06d1c40707fb]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:29 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 Apr 24 20:03:29 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:29 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec Apr 24 20:03:29 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:29 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4" returned: 0 in 0.471s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.299s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2130720649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838fbcd4-b65e-46b4-9deb-65491e4db1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7d5cd6f2ac429a9f5c79ffaa53d4a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:22Z,use_quota=True,user_id='7ab71c8c9ea048b5a305f6525715d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Creating volume 838fbcd4-b65e-46b4-9deb-65491e4db1c3 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:29 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:29 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec" returned: 0 in 0.533s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:03:29 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 1073741824 Apr 24 20:03:29 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08eb7ed7-ee34-4373-8e37-af2ce19eaf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8326343d-ed76-4e5a-b7f2-0040b111c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7039b7ce-bd9f-455d-af07-3ae3cd874c13]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:29 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 (a85d55e2-46fa-4530-97ff-4ca21f4c33c4): created successfully Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8326343d-ed76-4e5a-b7f2-0040b111c077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:29 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (19799adc-f1ce-4931-8d52-4ae01d15e340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:29 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1af7b37e-d0f5-4c15-bf59-631eb53c7f35 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created volume successfully. Apr 24 20:03:29 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 Apr 24 20:03:29 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:30 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" returned: 0 in 0.572s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:30 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 1073741824" returned: 0 in 0.636s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:30 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec Apr 24 20:03:30 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:30 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 Apr 24 20:03:30 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:30 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3" returned: 0 in 0.448s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.339s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:30 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Cloning volume e1f9471f-f306-47bb-87f1-3ea44fde092a to volume 4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57ccb89-43d0-42b5-b9cb-909076712b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3dda97-0b78-4b2f-b7bc-bda1233dd0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:30 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:30 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Volume volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 (838fbcd4-b65e-46b4-9deb-65491e4db1c3): created successfully Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3dda97-0b78-4b2f-b7bc-bda1233dd0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Flow 'volume_create_manager' (e3c353a6-be31-4fa7-938c-7f3acb11eda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec" returned: 0 in 0.579s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Creating offline snapshot 974b8de1-7cee-42cc-89ae-d63bb0f00077 of volume e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:03:30 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d34bb764-6134-40ff-8d01-69be34199625 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created volume successfully. Apr 24 20:03:30 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec Apr 24 20:03:30 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d74e87-4638-4f47-9937-46ffd1a63f04]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:30 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:31 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a Apr 24 20:03:31 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-838fbcd4-b65e-46b4-9deb-65491e4db1c3-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-838fbcd4-b65e-46b4-9deb-65491e4db1c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-quobyte-838fbcd4-b65e-46b4-9deb-65491e4db1c3" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-838fbcd4-b65e-46b4-9deb-65491e4db1c3" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd6f56-13ae-4b8f-9311-df421079b069]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:31 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 Apr 24 20:03:31 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:31 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56.5e93c66a-c4e5-4fee-a9b7-b41547f64fec" returned: 0 in 0.507s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-5e93c66a-c4e5-4fee-a9b7-b41547f64fec" released by "_delete_snapshot" :: held 2.315s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" released by "delete_snapshot" :: held 2.359s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:31 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a" returned: 0 in 0.603s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Created reservations ['e64b28ee-8054-4ac3-8d48-6505fc0f0ebd', '9c453f70-afd8-438b-9e11-9564d58f0b46', 'c924e695-9534-4d5a-a014-d3e20ca03487', '353d73c3-7459-43b8-964e-156c49964715'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:31 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 1G Apr 24 20:03:31 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:31 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Delete snapshot completed successfully. Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e9d856e2-61a4-4b8d-838f-ff9bcaa98a5d tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-5e93c66a-c4e5-4fee-a9b7-b41547f64fec-delete_snapshot" released by "delete_snapshot" :: held 2.528s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:31 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3" returned: 0 in 0.585s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:31 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:31 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3 Apr 24 20:03:31 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:32 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 1G" returned: 0 in 0.614s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f9471f-f306-47bb-87f1-3ea44fde092a -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:32 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:32 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f9471f-f306-47bb-87f1-3ea44fde092a -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 Apr 24 20:03:32 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-838fbcd4-b65e-46b4-9deb-65491e4db1c3" returned: 0 in 0.487s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-838fbcd4-b65e-46b4-9deb-65491e4db1c3" released by "delete_volume" :: held 1.116s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "cinder-quobyte-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created reservations ['87da36ff-b547-468a-914f-a48fece2ea94', '890ffe46-b36e-457f-bb59-1fd58c029200', '0b2438cd-2f4b-4efa-8efd-bd625325e61f', '928c169b-51d8-4173-90fd-c756228af291'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" acquired by "delete_volume" :: waited 0.024s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b7cb2-f175-4976-a04f-981efceeedd2]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:32 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:32 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:32 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 Apr 24 20:03:32 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:32 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f9471f-f306-47bb-87f1-3ea44fde092a -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077" returned: 0 in 0.535s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:32 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 is being set with open permissions: ugo+rw Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:32 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 Apr 24 20:03:32 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:32 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.496s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:32 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Deleted volume successfully. Apr 24 20:03:32 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-d8a5e65e-7e73-4b35-b3f7-02017cec3d7f tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-838fbcd4-b65e-46b4-9deb-65491e4db1c3-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:33 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" returned: 0 in 0.579s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:33 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56 Apr 24 20:03:33 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:33 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077" returned: 0 in 0.467s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:33 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.info Apr 24 20:03:33 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-a85d55e2-46fa-4530-97ff-4ca21f4c33c4-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-a85d55e2-46fa-4530-97ff-4ca21f4c33c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-quobyte-a85d55e2-46fa-4530-97ff-4ca21f4c33c4" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-a85d55e2-46fa-4530-97ff-4ca21f4c33c4" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[627685f4-d081-485f-8fc8-adb98b6900ab]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:33 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" returned: 0 in 0.457s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-quobyte-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56" released by "delete_volume" :: held 1.117s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:33 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 Apr 24 20:03:33 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Created reservations ['01e2605b-f89b-460a-b06c-75d6b58f0392', '21c70381-b96d-4e4c-829d-c67feb66c355', 'a6707aef-cba7-4472-af8f-e93026de8276', '4109f4ba-2289-4eca-89e7-a3ea892059fd'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:33 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:33 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:33 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.info" returned: 0 in 0.502s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:33 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.info is being set with open permissions: ugo+rw Apr 24 20:03:33 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:33 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.info Apr 24 20:03:33 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:34 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4" returned: 0 in 0.592s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:34 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4 Apr 24 20:03:34 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:34 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.430s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:34 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Deleted volume successfully. Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-44352a39-8197-48f5-a24e-98a1b9de1dcb tempest-CreateVolumesFromSnapshotTest-43736758 None] Lock "cinder-8ee66d3c-70f0-4e2e-bd9c-146fbdcf1c56-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:34 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.info" returned: 0 in 0.491s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] snapshot: 974b8de1-7cee-42cc-89ae-d63bb0f00077, volume: 4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b44b82c-d3f8-47ef-bdae-ffa319852cb9]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:34 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 Apr 24 20:03:34 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:34 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-a85d55e2-46fa-4530-97ff-4ca21f4c33c4" returned: 0 in 0.451s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-a85d55e2-46fa-4530-97ff-4ca21f4c33c4" released by "delete_volume" :: held 1.090s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created reservations ['3a21a431-5dd9-4816-964e-a9622a4530c9', '42e8f140-70d3-4f17-a608-2334f2f205de', 'fd71986e-b51c-41ec-998a-792f3bf87696', '49a7bb33-a423-40be-92f3-892fb32ce2ac'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:34 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:34 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:34 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077" returned: 0 in 0.567s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f9471f-f306-47bb-87f1-3ea44fde092a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fa0948-fe94-4100-b974-25911fff9e5a]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:34 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:34 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a Apr 24 20:03:34 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:35 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.594s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:35 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Deleted volume successfully. Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e434a3de-1267-49f3-bffa-6588161499f9 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-a85d55e2-46fa-4530-97ff-4ca21f4c33c4-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-6fe36015-a99e-43d8-ad44-35fe7f47201c-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-6fe36015-a99e-43d8-ad44-35fe7f47201c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-quobyte-6fe36015-a99e-43d8-ad44-35fe7f47201c" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:35 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a" returned: 0 in 0.688s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-6fe36015-a99e-43d8-ad44-35fe7f47201c" acquired by "delete_volume" :: waited 0.038s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:35 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 Apr 24 20:03:35 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2cfa8f-9b87-4329-9397-39f69f2fdf1f]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:35 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:35 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c Apr 24 20:03:35 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:36 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c" returned: 0 in 0.679s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:36 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:36 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c Apr 24 20:03:36 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:37 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-6fe36015-a99e-43d8-ad44-35fe7f47201c" returned: 0 in 1.051s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-6fe36015-a99e-43d8-ad44-35fe7f47201c" released by "delete_volume" :: held 1.792s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created reservations ['8756bd51-db52-441a-8be3-9c8de1559357', 'c4753531-ecfe-4757-8cd8-51f614be3b0c', '47986658-7802-47b7-8e0c-8d2a18ba19a1', '9cc0d35c-c068-4218-976f-e71a4ae02cf4'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:37 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:37 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-9cee2b3d-805b-466f-aaf6-b324a091739a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:37 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-9cee2b3d-805b-466f-aaf6-b324a091739a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-quobyte-9cee2b3d-805b-466f-aaf6-b324a091739a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-9cee2b3d-805b-466f-aaf6-b324a091739a" acquired by "delete_volume" :: waited 0.037s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeb0db3-9bbf-4f3d-a6be-133975a05c5e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:38 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a Apr 24 20:03:38 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Flow 'volume_create_manager' (0c23bfd8-c06d-4f09-a183-9ba62a1877ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c977879-ae1f-44d3-a7b7-92ad5f885cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c977879-ae1f-44d3-a7b7-92ad5f885cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893d3a8a-0784-441c-aa75-b6b534f2965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4934dc097045d1be1fdf51b6e7459c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:38Z,use_quota=True,user_id='733945ebc0684107ae80564fb455b719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d948f046-3111-428d-8a1a-1e3ac1b4dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d948f046-3111-428d-8a1a-1e3ac1b4dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52378230-7018-49e8-8ea0-762d3b1c931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52378230-7018-49e8-8ea0-762d3b1c931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '893d3a8a-0784-441c-aa75-b6b534f2965f', 'volume_name': 'volume-893d3a8a-0784-441c-aa75-b6b534f2965f', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653c379e-9fd6-4010-93f0-e7d13d658eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653c379e-9fd6-4010-93f0-e7d13d658eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbc7145-f34f-46bb-8fa9-58bbf9154097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:38 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Volume 893d3a8a-0784-441c-aa75-b6b534f2965f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-893d3a8a-0784-441c-aa75-b6b534f2965f', 'volume_size': 1} Apr 24 20:03:38 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:39 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 1.433s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:39 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:39 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Deleted volume successfully. Apr 24 20:03:39 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c47ffffa-1f18-42ae-b5cc-c64af8506aa3 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-6fe36015-a99e-43d8-ad44-35fe7f47201c-delete_volume" released by "delete_volume" :: held 3.590s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:39 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a" returned: 0 in 1.640s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:39 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:39 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a Apr 24 20:03:39 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:41 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-9cee2b3d-805b-466f-aaf6-b324a091739a" returned: 0 in 1.277s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-9cee2b3d-805b-466f-aaf6-b324a091739a" released by "delete_volume" :: held 3.033s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created reservations ['0c7abb72-f0fa-46d9-9204-1017fa15f3cb', 'e1cdd56f-ebf5-44c5-9ac5-7d4e7307e513', '7ac24d9e-9809-4abb-b7e7-60040de43294', 'f2236c28-3455-45bd-a17c-905143a6d0f5'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:41 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" returned: 0 in 5.595s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0580fa-e029-40a1-b114-8f3a43e25599]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:41 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:41 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:41 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a Apr 24 20:03:41 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-1688ae03-fd4e-46f6-860c-aec2d3bfd864-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-1688ae03-fd4e-46f6-860c-aec2d3bfd864-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-quobyte-1688ae03-fd4e-46f6-860c-aec2d3bfd864" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-1688ae03-fd4e-46f6-860c-aec2d3bfd864" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b0ff68-2470-4f40-8f14-b430d311da12]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:41 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 Apr 24 20:03:41 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:41 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.498s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:41 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Deleted volume successfully. Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fa011046-bcfd-47aa-8b7f-49bf8c334c8d tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-9cee2b3d-805b-466f-aaf6-b324a091739a-delete_volume" released by "delete_volume" :: held 3.854s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:41 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a" returned: 0 in 0.678s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:03:41 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Converted 1024.00 MB image at 182.98 MB/s Apr 24 20:03:41 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 is being set with open permissions: ugo+rw Apr 24 20:03:41 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:41 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 Apr 24 20:03:41 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:42 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864" returned: 0 in 0.553s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:42 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864 Apr 24 20:03:42 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:42 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" returned: 0 in 0.428s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" released by "_copy_volume_from_snapshot" :: held 8.048s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-974b8de1-7cee-42cc-89ae-d63bb0f00077" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-974b8de1-7cee-42cc-89ae-d63bb0f00077" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Deleting offline snapshot 974b8de1-7cee-42cc-89ae-d63bb0f00077 of volume e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] snapshot_file for this snap is: volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c185fb-f9af-4a9c-b376-6dfcf5788ee5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:42 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 Apr 24 20:03:42 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:42 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-1688ae03-fd4e-46f6-860c-aec2d3bfd864" returned: 0 in 0.447s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-1688ae03-fd4e-46f6-860c-aec2d3bfd864" released by "delete_volume" :: held 1.047s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created reservations ['88638f96-97ff-46ab-8678-311837fc9c27', '5a3cbfe8-6fb4-440e-981f-68d3f85242b1', 'ce227942-e469-498a-9197-fbd2d36cbcf0', 'f9297178-9768-48d4-9440-98021a620a1b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:42 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:42 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:42 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077" returned: 0 in 0.532s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f9471f-f306-47bb-87f1-3ea44fde092a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[91041be3-7b0a-4a3f-9e18-df2afc87f8b0]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:42 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:43 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a Apr 24 20:03:43 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:43 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.476s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:43 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Deleted volume successfully. Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-13ae4b05-15a1-4114-a5da-66f356b1f935 tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-1688ae03-fd4e-46f6-860c-aec2d3bfd864-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:43 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a" returned: 0 in 0.526s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:43 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 Apr 24 20:03:43 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "cinder-quobyte-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83" acquired by "delete_volume" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[85782c51-aa40-4569-8fd3-19eb40cbc1d6]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:43 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:43 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 Apr 24 20:03:43 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:44 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077" returned: 0 in 0.595s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:44 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077 Apr 24 20:03:44 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:44 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83" returned: 0 in 0.523s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:44 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83 Apr 24 20:03:44 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:44 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a.974b8de1-7cee-42cc-89ae-d63bb0f00077" returned: 0 in 0.445s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-974b8de1-7cee-42cc-89ae-d63bb0f00077" released by "_delete_snapshot" :: held 2.186s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.719s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "cinder-quobyte-0d2043a0-447b-486d-9644-b56a2943c990-07a0342d-1e63-463b-ad7f-5be454b8a7d2" by "_create_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad6b09a-5414-4ad0-85ed-8e6a8aa6c156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9', 'volume_size': 1, 'source_volid': 'e1f9471f-f306-47bb-87f1-3ea44fde092a', 'source_volstatus': 'available'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5eb864-1ea9-452b-bb20-746662fc5823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-0d2043a0-447b-486d-9644-b56a2943c990-07a0342d-1e63-463b-ad7f-5be454b8a7d2" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Creating volume 07a0342d-1e63-463b-ad7f-5be454b8a7d2 from snapshot 0d2043a0-447b-486d-9644-b56a2943c990 {{(pid=81641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "cinder-quobyte-07a0342d-1e63-463b-ad7f-5be454b8a7d2" by "_copy_volume_from_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:44 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Volume volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 (4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9): created successfully Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5eb864-1ea9-452b-bb20-746662fc5823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Flow 'volume_create_manager' (273e7e97-648a-4b30-9e03-4f3614d369d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:44 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-fdf5d4cd-836a-4398-9ea7-e883852d37ee tempest-VolumeDependencyTests-1633329746 None] Created volume successfully. Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-07a0342d-1e63-463b-ad7f-5be454b8a7d2" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] snapshot: 0d2043a0-447b-486d-9644-b56a2943c990, volume: 07a0342d-1e63-463b-ad7f-5be454b8a7d2, {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1fddf6-7ac6-4dca-aa1d-fe2b1d022ce4]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-e1f9471f-f306-47bb-87f1-3ea44fde092a-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-e1f9471f-f306-47bb-87f1-3ea44fde092a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-e1f9471f-f306-47bb-87f1-3ea44fde092a" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-e1f9471f-f306-47bb-87f1-3ea44fde092a" acquired by "delete_volume" :: waited 0.018s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:44 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83" returned: 0 in 0.547s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-quobyte-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83" released by "delete_volume" :: held 1.111s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[90786d1c-9571-47d5-b6a5-e9d494e8ce2e]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:44 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 Apr 24 20:03:44 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:44 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Created reservations ['d73d1d24-f9b6-43f0-a928-718a9029fda3', '8beb3145-9357-46c7-9f05-62bbc087e2a3', 'a8ee5804-7433-4983-aa20-0600ce581d88', '4ca9b73e-7c8e-4124-8e73-c8a1850228b6'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:44 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a Apr 24 20:03:44 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:45 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:45 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:45 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a" returned: 0 in 0.515s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:45 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a Apr 24 20:03:45 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:45 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990" returned: 0 in 0.719s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-790d17c4-c6b6-4d71-89f1-49d2352d4097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Creating direct copy from snapshot {{(pid=81641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 20:03:45 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.432s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8b56a7-53d5-4e79-970d-c16df9c0bdd9]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:45 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Deleted volume successfully. Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-14712fec-3acf-4659-b21a-a8d6065c61ad tempest-CreateVolumesFromSourceVolumeTest-237941636 None] Lock "cinder-3ddae5e0-c1bd-4490-b7c5-dd5abb50cd83-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:45 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 Apr 24 20:03:45 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:45 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-e1f9471f-f306-47bb-87f1-3ea44fde092a" returned: 0 in 0.417s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-e1f9471f-f306-47bb-87f1-3ea44fde092a" released by "delete_volume" :: held 1.026s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:45 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Created reservations ['8343a8ef-5160-471e-b8ee-71fdf3c5f971', '51fab6b7-f40d-4b19-8590-462a89066efc', 'f7b68dcc-8d0f-4771-aa14-62ad03e9e9a0', '0c22ad3b-4187-417b-9b04-80b647831885'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:46 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:46 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:46 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097" returned: 0 in 0.617s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG cinder.utils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Path /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 not found in is_blk_device check {{(pid=81641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:46 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 Apr 24 20:03:46 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:46 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.539s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:46 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Deleted volume successfully. Apr 24 20:03:46 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-2111a3ea-8fe3-43e3-acc7-20c20b2e4be7 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-e1f9471f-f306-47bb-87f1-3ea44fde092a-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:47 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" acquired by "delete_volume" :: waited 0.042s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:47 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1754596a-c2f2-4571-937a-d0d1979c5b23]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:47 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:47 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 Apr 24 20:03:47 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:48 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" returned: 0 in 1.321s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:48 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:48 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9 Apr 24 20:03:48 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:49 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" returned: 0 in 0.812s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:49 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9" released by "delete_volume" :: held 2.257s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:49 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Created reservations ['47ceb299-d681-40d4-aa16-134cb98937fe', 'b58691c4-9db7-4064-8d8c-2efc1849accf', 'af969345-28fb-4410-8d55-a85ca4e4f204', 'efc6063e-b47f-442d-be1f-dc96888e346d'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:49 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:49 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:50 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:50 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:50 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:50 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.873s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:50 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:50 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Deleted volume successfully. Apr 24 20:03:50 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8e9cfd5c-20b3-4d42-a803-47c70308bfe4 tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-4a47a733-1c5d-43ec-9d97-aa5e1f2c4ea9-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-72b7c890-6525-4c2f-8c4e-4b85a75d52df-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-72b7c890-6525-4c2f-8c4e-4b85a75d52df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "cinder-quobyte-72b7c890-6525-4c2f-8c4e-4b85a75d52df" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-72b7c890-6525-4c2f-8c4e-4b85a75d52df" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[743db976-63c1-4ba1-84c3-f00a95b8e2e8]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:51 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df Apr 24 20:03:51 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:51 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2" returned: 0 in 5.442s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2118903-4648-4273-abe0-164f5a1b3cbf]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:51 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 Apr 24 20:03:51 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:51 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df" returned: 0 in 0.639s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:51 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:51 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df Apr 24 20:03:51 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:52 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097" returned: 0 in 0.734s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.image.image_utils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 {{(pid=81641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 20:03:52 devstack cinder-volume[81641]: INFO cinder.image.image_utils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Converted 1024.00 MB image at 188.12 MB/s Apr 24 20:03:52 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 is being set with open permissions: ugo+rw Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:52 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-72b7c890-6525-4c2f-8c4e-4b85a75d52df" returned: 0 in 0.479s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:52 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 Apr 24 20:03:52 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-quobyte-72b7c890-6525-4c2f-8c4e-4b85a75d52df" released by "delete_volume" :: held 1.216s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Created reservations ['898b8791-ecfb-44d6-810c-20796c258f41', '48225319-45ff-48ef-8606-be33ecc2c6b9', '7736aad5-52ee-4977-ace5-b26d45d824b5', 'e35f55ea-5239-42bc-b7c2-7d5b1aab59ed'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:52 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:52 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:52 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2" returned: 0 in 0.473s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-07a0342d-1e63-463b-ad7f-5be454b8a7d2" released by "_copy_volume_from_snapshot" :: held 8.109s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-0d2043a0-447b-486d-9644-b56a2943c990-07a0342d-1e63-463b-ad7f-5be454b8a7d2" released by "_create_volume_from_snapshot" :: held 8.174s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.221s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.983s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=893d3a8a-0784-441c-aa75-b6b534f2965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4934dc097045d1be1fdf51b6e7459c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:38Z,use_quota=True,user_id='733945ebc0684107ae80564fb455b719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Creating volume 893d3a8a-0784-441c-aa75-b6b534f2965f {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:52 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:52 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f 1073741824 Apr 24 20:03:52 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982c8808-6f24-4b2d-bdd7-fcde5b2a1440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2', 'volume_size': 1, 'snapshot_id': '0d2043a0-447b-486d-9644-b56a2943c990'}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a0cd04-36c7-49e5-9b25-8fd388e44bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:52 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Volume volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 (07a0342d-1e63-463b-ad7f-5be454b8a7d2): created successfully Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a0cd04-36c7-49e5-9b25-8fd388e44bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Flow 'volume_create_manager' (b1a0809e-4130-4797-9999-07694c61f95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:52 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f19122ee-6a1c-4df7-85a1-0a2b6b634453 tempest-SnapshotDependencyTests-129297756 None] Created volume successfully. Apr 24 20:03:52 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.483s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:52 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Deleted volume successfully. Apr 24 20:03:52 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-c6131340-f86f-4857-97b6-a687ecbe50fe tempest-VolumeDependencyTests-1633329746 None] Lock "cinder-72b7c890-6525-4c2f-8c4e-4b85a75d52df-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG oslo_service.periodic_task [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:53 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:53 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:53 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:53 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f 1073741824" returned: 0 in 0.688s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.453s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-d1505ca1-3eae-49b1-81d9-e04e59dee5c9 None None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:53 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f Apr 24 20:03:53 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "cinder-0d2043a0-447b-486d-9644-b56a2943c990-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-0d2043a0-447b-486d-9644-b56a2943c990-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "cinder-quobyte-790d17c4-c6b6-4d71-89f1-49d2352d4097" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-790d17c4-c6b6-4d71-89f1-49d2352d4097" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:53 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "cinder-quobyte-0d2043a0-447b-486d-9644-b56a2943c990" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-0d2043a0-447b-486d-9644-b56a2943c990" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Deleting offline snapshot 0d2043a0-447b-486d-9644-b56a2943c990 of volume 790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] snapshot_file for this snap is: volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e274ba51-e611-4339-987c-231a6822924c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:54 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f" returned: 0 in 0.509s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbc7145-f34f-46bb-8fa9-58bbf9154097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-893d3a8a-0784-441c-aa75-b6b534f2965f', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f330163-480e-4396-8d89-0c17ab7aa3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:54 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Volume volume-893d3a8a-0784-441c-aa75-b6b534f2965f (893d3a8a-0784-441c-aa75-b6b534f2965f): created successfully Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f330163-480e-4396-8d89-0c17ab7aa3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Flow 'volume_create_manager' (0c23bfd8-c06d-4f09-a183-9ba62a1877ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:54 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-1be8821a-ccc7-4d79-9bda-37aa7c1ba6d0 tempest-CinderUnicodeTest-42427380 None] Created volume successfully. Apr 24 20:03:54 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 Apr 24 20:03:54 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:54 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990" returned: 0 in 0.624s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-790d17c4-c6b6-4d71-89f1-49d2352d4097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[daec6ffe-e5af-4986-9520-7b3d1a5352e0]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:54 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:54 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 Apr 24 20:03:54 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:55 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097" returned: 0 in 0.582s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:55 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 Apr 24 20:03:55 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Flow 'volume_create_manager' (58b6ac61-6f95-4ba0-a02e-85ce458e590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5324b4a-2b22-4507-b85e-79c94d711d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5324b4a-2b22-4507-b85e-79c94d711d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1737874030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f63251-43d9-493c-b5d9-77b4b08878f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4934dc097045d1be1fdf51b6e7459c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:55Z,use_quota=True,user_id='733945ebc0684107ae80564fb455b719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f4438f-325f-4780-b29f-0373cab136fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f4438f-325f-4780-b29f-0373cab136fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813170de-ef82-4e31-845f-fef964da52c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813170de-ef82-4e31-845f-fef964da52c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f63251-43d9-493c-b5d9-77b4b08878f7', 'volume_name': 'volume-26f63251-43d9-493c-b5d9-77b4b08878f7', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5422ede2-35e9-4013-918f-1b2a1e49e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5422ede2-35e9-4013-918f-1b2a1e49e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ad0362-22ef-437d-93d1-200e83ce2d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:55 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Volume 26f63251-43d9-493c-b5d9-77b4b08878f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f63251-43d9-493c-b5d9-77b4b08878f7', 'volume_size': 1} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T18:03:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1737874030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f63251-43d9-493c-b5d9-77b4b08878f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4934dc097045d1be1fdf51b6e7459c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T18:03:55Z,use_quota=True,user_id='733945ebc0684107ae80564fb455b719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0629e38f-e5b9-4d33-a6c7-7169df180f0a),volume_type_id=0629e38f-e5b9-4d33-a6c7-7169df180f0a)}" {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Creating volume 26f63251-43d9-493c-b5d9-77b4b08878f7 {{(pid=81641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Selected osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 as target Quobyte volume. {{(pid=81641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 20:03:55 devstack cinder-volume[81641]: INFO cinder.volume.drivers.remotefs [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] casted to osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843 Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 1073741824 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:55 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 1073741824 Apr 24 20:03:55 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:55 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990" returned: 0 in 0.530s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:55 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:55 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990 Apr 24 20:03:55 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:56 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 1073741824" returned: 0 in 0.625s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:56 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 Apr 24 20:03:56 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:56 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097.0d2043a0-447b-486d-9644-b56a2943c990" returned: 0 in 0.481s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-0d2043a0-447b-486d-9644-b56a2943c990" released by "_delete_snapshot" :: held 2.326s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-790d17c4-c6b6-4d71-89f1-49d2352d4097" released by "delete_snapshot" :: held 2.353s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Created reservations ['1ecaf877-52ff-4ce5-b621-2d6483714fab', '9430fdbb-b584-4780-8c6f-d86fb4c38d9f', '37fff82c-c455-4c9b-a67c-05298c850495', '069acea9-bbb6-4ea2-b651-df85901fdc4b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Delete snapshot completed successfully. Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-218e9526-6073-43f5-a9f1-0c9135cee1dc tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-0d2043a0-447b-486d-9644-b56a2943c990-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:56 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7" returned: 0 in 0.495s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'} {{(pid=81641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ad0362-22ef-437d-93d1-200e83ce2d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f63251-43d9-493c-b5d9-77b4b08878f7', 'volume_size': 1}' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9b8a18-cd71-4203-a3c3-20591c4d2ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 20:03:56 devstack cinder-volume[81641]: INFO cinder.volume.flows.manager.create_volume [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Volume volume-26f63251-43d9-493c-b5d9-77b4b08878f7 (26f63251-43d9-493c-b5d9-77b4b08878f7): created successfully Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9b8a18-cd71-4203-a3c3-20591c4d2ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 20:03:56 devstack cinder-volume[81641]: DEBUG cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Flow 'volume_create_manager' (58b6ac61-6f95-4ba0-a02e-85ce458e590f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 20:03:56 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-f3876b63-48af-4885-a661-d124d2469b9f tempest-CinderUnicodeTest-42427380 None] Created volume successfully. Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "cinder-790d17c4-c6b6-4d71-89f1-49d2352d4097-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-790d17c4-c6b6-4d71-89f1-49d2352d4097-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "cinder-quobyte-790d17c4-c6b6-4d71-89f1-49d2352d4097" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-790d17c4-c6b6-4d71-89f1-49d2352d4097" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0175b85-51b9-43b2-a242-6cea3ae9e76d]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:57 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 Apr 24 20:03:57 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Creating offline snapshot c9d6818a-0aef-48b1-a8fa-1ebba0159fdb of volume 26f63251-43d9-493c-b5d9-77b4b08878f7 {{(pid=81641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9163e212-973f-4d15-a844-329544dc73ee]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:57 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 Apr 24 20:03:57 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:57 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097" returned: 0 in 0.565s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:57 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:57 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097 Apr 24 20:03:57 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:58 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-790d17c4-c6b6-4d71-89f1-49d2352d4097" returned: 0 in 0.436s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-790d17c4-c6b6-4d71-89f1-49d2352d4097" released by "delete_volume" :: held 1.072s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:58 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Created reservations ['386d950a-3731-4062-b686-63321dc01165', '01ff2d52-7c75-41a6-8d8f-fff8b2149f31', 'd29d26ac-6e2a-4812-a154-70fdb54f7330', '246e7f81-297b-4893-9024-7820c8827e6f'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7" returned: 0 in 0.598s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb 1G {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:58 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb 1G Apr 24 20:03:58 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:58 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:03:58 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:58 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.464s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:03:58 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Deleted volume successfully. Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-e16d0234-0137-430c-9b29-636707727344 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-790d17c4-c6b6-4d71-89f1-49d2352d4097-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:03:58 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb 1G" returned: 0 in 0.628s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:58 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f63251-43d9-493c-b5d9-77b4b08878f7 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:58 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f63251-43d9-493c-b5d9-77b4b08878f7 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb Apr 24 20:03:58 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "cinder-07a0342d-1e63-463b-ad7f-5be454b8a7d2-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-07a0342d-1e63-463b-ad7f-5be454b8a7d2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "cinder-quobyte-07a0342d-1e63-463b-ad7f-5be454b8a7d2" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-07a0342d-1e63-463b-ad7f-5be454b8a7d2" acquired by "delete_volume" :: waited 0.015s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[355c236d-c11e-480c-ae98-9165d2eed519]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:59 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f63251-43d9-493c-b5d9-77b4b08878f7 -F qcow2 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb" returned: 0 in 0.534s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:59 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb is being set with open permissions: ugo+rw Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:03:59 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb Apr 24 20:03:59 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:59 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 Apr 24 20:03:59 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:03:59 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb" returned: 0 in 0.443s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=162,cinder:UPDATE=244,cinder:INSERT=59,cinder:DELETE=21 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=165,cinder:INSERT=53,cinder:UPDATE=221,cinder:DELETE=19 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 20:03:59 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:00 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:00 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.info Apr 24 20:04:00 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2" returned: 0 in 0.531s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:00 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2 Apr 24 20:04:00 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:00 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.info" returned: 0 in 0.438s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:00 devstack cinder-volume[81641]: WARNING cinder.volume.drivers.remotefs [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.info is being set with open permissions: ugo+rw Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.info {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:00 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-07a0342d-1e63-463b-ad7f-5be454b8a7d2" returned: 0 in 0.440s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:00 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.info Apr 24 20:04:00 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-quobyte-07a0342d-1e63-463b-ad7f-5be454b8a7d2" released by "delete_volume" :: held 1.009s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Created reservations ['40c87c31-428f-43ab-bf0a-5acf10b9009e', 'a2e20330-c70f-49f0-8861-bfcc8e3004fb', '22712b66-1c7f-44a3-9c27-bb45d885dd5f', '46841a62-93bb-423a-88f1-fde263fc61eb'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:00 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:04:00 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:00 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.info" returned: 0 in 0.462s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:00 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.198s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:04:00 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-440011a5-d4df-4aee-bbcc-157d9c907eb9 tempest-CinderUnicodeTest-42427380 None] Create snapshot completed successfully Apr 24 20:04:01 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.465s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:04:01 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Deleted volume successfully. Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-8f6a390e-0df3-471b-99cf-410ea43ddcf9 tempest-SnapshotDependencyTests-129297756 None] Lock "cinder-07a0342d-1e63-463b-ad7f-5be454b8a7d2-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Acquiring lock "cinder-c9d6818a-0aef-48b1-a8fa-1ebba0159fdb-delete_snapshot" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-c9d6818a-0aef-48b1-a8fa-1ebba0159fdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Acquiring lock "cinder-quobyte-26f63251-43d9-493c-b5d9-77b4b08878f7" by "delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-quobyte-26f63251-43d9-493c-b5d9-77b4b08878f7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Acquiring lock "cinder-quobyte-c9d6818a-0aef-48b1-a8fa-1ebba0159fdb" by "_delete_snapshot" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-quobyte-c9d6818a-0aef-48b1-a8fa-1ebba0159fdb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Deleting offline snapshot c9d6818a-0aef-48b1-a8fa-1ebba0159fdb of volume 26f63251-43d9-493c-b5d9-77b4b08878f7 {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] snapshot_file for this snap is: volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb {{(pid=81641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8027ea-54a6-4389-af84-01186d9717d5]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:04:01 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:02 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb Apr 24 20:04:02 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:02 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb" returned: 0 in 0.529s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:02 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.remotefs [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26f63251-43d9-493c-b5d9-77b4b08878f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 20:04:02 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9758bb-b11a-491f-9ed4-10aee940d7d9]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:04:02 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:02 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 Apr 24 20:04:02 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:03 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7" returned: 0 in 0.550s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:03 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb Apr 24 20:04:03 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:03 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb" returned: 0 in 0.611s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:03 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:03 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb Apr 24 20:04:03 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:04 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:04 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7.c9d6818a-0aef-48b1-a8fa-1ebba0159fdb" returned: 0 in 0.470s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-quobyte-c9d6818a-0aef-48b1-a8fa-1ebba0159fdb" released by "_delete_snapshot" :: held 2.272s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:04:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-quobyte-26f63251-43d9-493c-b5d9-77b4b08878f7" released by "delete_snapshot" :: held 2.296s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:04:04 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Created reservations ['15ab11d3-ca48-4348-8b85-936b726f063a', '4b2c3652-b16e-4e02-aa2b-b90b09fe5f0a', 'd3342298-ee1f-46b4-b77d-f63251bfc386', '546763e9-fc34-465f-add9-738a273f2f61'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:04:04 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Delete snapshot completed successfully. Apr 24 20:04:04 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-333a5642-16ba-4e53-9179-58027652af13 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-c9d6818a-0aef-48b1-a8fa-1ebba0159fdb-delete_snapshot" released by "delete_snapshot" :: held 2.442s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:04:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Acquiring lock "cinder-26f63251-43d9-493c-b5d9-77b4b08878f7-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:04:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Lock "cinder-26f63251-43d9-493c-b5d9-77b4b08878f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:04:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Acquiring lock "cinder-quobyte-26f63251-43d9-493c-b5d9-77b4b08878f7" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:04:05 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Lock "cinder-quobyte-26f63251-43d9-493c-b5d9-77b4b08878f7" acquired by "delete_volume" :: waited 0.025s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:04:05 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7192d21d-8593-4be4-b940-ac8f0b65a711]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:04:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:05 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 Apr 24 20:04:05 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:05 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7" returned: 0 in 0.580s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:05 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:05 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7 Apr 24 20:04:05 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:06 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-26f63251-43d9-493c-b5d9-77b4b08878f7" returned: 0 in 0.511s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:06 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Lock "cinder-quobyte-26f63251-43d9-493c-b5d9-77b4b08878f7" released by "delete_volume" :: held 1.166s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:04:06 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Created reservations ['52223bcd-199f-4233-ad44-3330b5c65d3d', '2dfbdce6-7c6a-4f3a-8ef6-207742d9e69b', '136ec882-33bc-4c97-b0f8-4b584cc36932', 'ae0f482f-e0f7-4c66-8341-c108c0b7d2fb'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:04:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:04:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:04:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:04:06 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:04:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:04:06 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:06 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:04:06 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:07 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.455s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:07 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:04:07 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Deleted volume successfully. Apr 24 20:04:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-dc3cdfd0-3dc9-4e32-95ef-80c7d29d23ea tempest-CinderUnicodeTest-42427380 None] Lock "cinder-26f63251-43d9-493c-b5d9-77b4b08878f7-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:04:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Acquiring lock "cinder-893d3a8a-0784-441c-aa75-b6b534f2965f-delete_volume" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:04:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-893d3a8a-0784-441c-aa75-b6b534f2965f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:04:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Acquiring lock "cinder-quobyte-893d3a8a-0784-441c-aa75-b6b534f2965f" by "delete_volume" {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 20:04:07 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-quobyte-893d3a8a-0784-441c-aa75-b6b534f2965f" acquired by "delete_volume" :: waited 0.023s {{(pid=81641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 20:04:07 devstack cinder-volume[81641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc2c3bc-a5b8-49c6-8fc3-ec2dd6ada41c]: (4, 'qcow2') {{(pid=82766) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 20:04:07 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:07 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f Apr 24 20:04:07 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:08 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f" returned: 0 in 0.636s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:08 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f Apr 24 20:04:08 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:08 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0/volume-893d3a8a-0784-441c-aa75-b6b534f2965f" returned: 0 in 0.515s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-quobyte-893d3a8a-0784-441c-aa75-b6b534f2965f" released by "delete_volume" :: held 1.194s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG cinder.quota [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Created reservations ['cf8cc1ca-0509-4e2a-8b74-51bc103db521', '938a1cc3-c7c2-4990-8995-896f68c76d92', '805d0259-a194-45c7-be73-a82cf3aa8497', '466a64d6-acc4-47e4-91e2-82df9a5fd68b'] {{(pid=81641) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843': None} {{(pid=81641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG cinder.volume.drivers.quobyte [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bc471e99-ec34-4da5-8ec5-aff483e41843'] {{(pid=81641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.lockutils [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 20:04:08 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 20:04:08 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0 Apr 24 20:04:08 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 20:04:09 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Apr 24 20:04:09 devstack cinder-volume[81641]: DEBUG oslo_concurrency.processutils [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f63c8838e3878f583c5c32f9a4143a0" returned: 0 in 0.505s {{(pid=81641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 20:04:09 devstack cinder-volume[81641]: DEBUG cinder.manager [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Notifying Schedulers of capabilities ... {{(pid=81641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 20:04:09 devstack cinder-volume[81641]: INFO cinder.volume.manager [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Deleted volume successfully. Apr 24 20:04:09 devstack cinder-volume[81641]: DEBUG cinder.coordination [None req-fd1c6c14-d48f-432c-ba82-ea6ccfe43877 tempest-CinderUnicodeTest-42427380 None] Lock "cinder-893d3a8a-0784-441c-aa75-b6b534f2965f-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=81641) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 20:04:18 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=23,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 20:04:19 devstack cinder-volume[81641]: DEBUG dbcounter [-] [81641] Writing DB stats cinder:SELECT=19,cinder:UPDATE=30,cinder:INSERT=10,cinder:DELETE=2 {{(pid=81641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}